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PEEFACE 


This book is in part a consequence of a long series of irritations on the 
part of the senior author. During the course of years he encountered 
too often tables of unsmoothed values, tables without descriptive legends 
or with inadequate legends, graphs with poorly chosen coordinate 
scales, graphs without accompanjdng descriptive legends and occasion- 
ally without indication as to what the coordinates themselves repre- 
sented, references to the significance of a so-called knee of a curve when 
the location of the knee was a function of the chosen coordinate scales, 
lack of understanding of how to determine, to express, and to apply 
precision indexes, blind faith in a least squares computation regardless 
of the assumptions and limitations, and many other faults which may 
be remedied with reasonable effort. For several years, this author has 
offered a course for graduate students entitled Treatment of Experimental 
Data in which such matters among others have been discussed. The 
present textbook is an outgrowth of that course. 

This book has been written with the physicist, the chemist, and the 
engineer in mind. The authors feel that, for a very large percentage of 
them, the book has a worth-while message. Although obviously the 
discussions are necessarily rather mathematical, considerable effort 
has been made to keep physical situations in mind throughout. 

We have generally steered away from the statistical treatment of 
quantum mechanics on the one hand and of business and educational 
theory on the other hand. We .do, however, include a chapter on 
correlation. 

As determinants shorten and simplify many treatments, they have 
been used in discussions wherever convenient. Eecognizing, however, 
that many users of this text may need to have their memories refreshed 
with regard to methods of use, A Brief Discussion of Determinant, 
Methods has been included as Appendix 1. In the discussion there given, 
particular attention has been paid to the processes 'of setting up, simpli- 
fying, and evaluating and to their application in solving simultaneous 
equations and in determining the equations of curves. The convenience 
obtained and the time saved by the use of determinants should be 
better known. 

The text, despite much care, probably contains many errors. Some 
of them undoubtedly reflect lack of knowledge on the part of the authors, 
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in by various paths. Whatever their origins, 
vho discover them will be kind enough to notify the 
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[Symbols concerned with Fourier Series expansions are defined at appropriate places in Chapter V] 
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CHAPTER I 


REPRESENTATION OF DATA BY TABLES 

1. Introduction. All of us, whether we realize it or not, are contin- 
ually making measurements. Such actions as noting the time of day, 
weighing oneself, and feeling the temperature of a tub of water with 
one’s hand or foot are typical commonplace observations. Usually the 
results of such observations are easily obtained, of little consequence, 
and soon forgotten. However, measurements made by a tailor in fitting 
a suit of clothes, a physician in diagnosing a disease, or a physicist in 
measuring the speed of light are of greater significance. Here the accu- 
racy of the measurements is a matter of concern; and it is often neces- 
sary that the measurements be analyzed to obtain the desired final 
result. It is usually important that the results be preserved, at least 
temporarily; and it is desirable to present them in a form convenient for 
use and readily understood by others. It is with such problems that 
this book is concerned. 

All data, unless scattered, are encountered and dealt with in the form 
of tables, graphs, or equations. It is appropriate, therefore, that we 
begin with a discussion of these three devices for representing data, 
pointing out the advantages and disadvantages of each, describing the 
rules for their proper usage, and illustrating the applications for which 
each is best suited. Since original data are usually first tabulated, then 
graphed, and finally perhaps expressed as equations, we consider first 
the methods and principles of tabular representation. 

All measurements involve at least two variables, one assumed inde- 
pendent and the other dependent. In the simplest measurements, the 
independent variable is ignored. Thus, recognizing the fact that apples, 
on standing, lose weight by evaporation of water through the skins, we 
may consider the weight of a bag of apples as a function of the time 
elapsed since picking. Generally, though, the observation that a bag 
of apples weighs 5 pounds contains all the information desired; it adds 
nothing to specify the time, the independent variable. More often, we 
are interested in both dependent and independent variables, and fre- 
quently in the relationship between them. In the tabular representa- 
tion of data, the assumed dependent and independent variables and their 
relationship— if one exists— are expressed by listing corresponding values 
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or properties of the variables in an orderly arrangement. As illustrated 
by newspaper radio programs, stock-market reports, railroad timetables, 
logarithm tables, and trigonometric tables, there are many types. 

In this chapter we shall first discuss the general advantages of tables, 
and then give the structural forms of each of three types. Specific rules 
are included for the construction of the one showing y = f{x)j together 
with two simple methods of smoothing data. The important problem 
of interpolation is discussed, and several interpolation formulas are de- 
veloped and illustrated. The chapter concludes with a discussion of 
extrapolation. 

2. Advantages of Tables. In favor of tables generally, it may be said 
that (a) they are simple and inexpensive to construct, requiring no 
special types of paper, curve forms, etc.; (6) they permit easy reference 
to data; (c) they facilitate comparisons of values, and (c?)'they provide 
a compact form for filing. In certain applications they possess special 
advantages. Thus, a table may show variations for several dependent 
variables as satisfactorily as for just one. It would be difficult to pre- 
sent the same data on a single graph 'without confusion. The table is 
generally preferable to the graph for presenting data which may be 
classified and subclassified in various ways. Finally, when the table is 
of the t 3 rpe showing y = /(x), the element /(a;) can often be differentiated 
or integrated directly from the table to the desired accuracy without 
knowledge of its mathematical form, and with less labor than is involved 
when a graph is used. 

3, Types of Tables. Tables may be grouped into three general 
classes. The first and least important class — ^the qualitative class — 
contains those tables which relate quantities in a qualitative way. 
Table I is a typical example. Its construction and interpretation are 
sufficiently simple to require no explanation. The occurrence of the 
qualitative table is relatively infrequent despite the fact that it contains 
data which cannot be well presented in any other way. 

The second class of tables — the statistical class — contains tables in 
which some of the variables are expressed quantitatively, while others, 
usually including the variable assumed independent, are not. (See 
Table II.) This class includes most statistical tables such as those in 
the World Almanac and U. S. Census reports, tables of equivalents, and 
the periodic table of the chemical elements. 

The third class of tables— the functional class — is composed of tables 
which show one or more relations of the type 2/ = f{x). Table III is a 
typical example. 

We are here principally concerned with the construction and inter- 
pretation of tables of the second and third classes. 
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TABLE 1. An Example OF THE Qualitative Type of Table 
Parallelism of Physical Theories ^ 


THEORIES OF LIGHT 

1. Corpuscular Theory: 

Corpuscles obey Newton's laws of me- 
chanics. 

2. Modified Corpuscular Theory of Planck 
and Einstein: 

Quantum laws govern the behavior of 
photons. 

3. Wave Theory: 

Theory deals with continuous waves, 
yielding interference and diffraction ef- 
fects. Standing waves produced by in- 
terference correspond to quantization. 
No mention of particles. 

4. Einsteins “Ghost Field” Interpretation: 
Interpretation reconciles corpuscular 

and wave theories ... 


THEORIES OF MATTER 

1. Corpuscular Theory: 

Particles obey Newton's laws of me- 
chanics. 

2. Modified Corpuscular Theory of Hei- 

Quantum laws govern the behavior of 
particles. 

3. Wave Theory: 

Theory deals with continuous waves, 
yielding interference and diffraction ef- 
fects. Quantization . . . corresponds to 
standing waves. No mention of particles 
in certain extreme forms of the theory. 

4. Born^s Probability Interpretation: 
Interpretation reconciles corpuscular 

and wave theories ... 


1 Physics Staff of the University of Pittsburgh, An Outline of Atomic Physics, p. 142, 2nd Ed., New 
York, John Wiley Sons, 1937. 


TABLE II. An Example of the Statistical Type of Table 


Certain Elements of the Solar System ^ 


Name 

Mean Dist. 
from Sun 
in 10® Km. 

Period 

1 

i 

Mass 

Mean 

Specific 

Gravity 

Relative 

Surface 

Gravity 

in Years 

Mass of Earth 

Sun 

Moon 

149.45 


331950 

0.012261 

1.41 

3.33 

27.89 

0.165 

Mercury 

57.85 

0.2408 

0.04 

3.8 

0.27 

Venus 

108.10 

0.6152 

0.81 

4.86‘ 

0.85 

Earth 

149.46 

1.0000 

1.000 

5.52 

1.00 

Mars j 

227.72 

1,8808 

0.108 

3.96 

0.38 

Ceres i 

413.58 

4.6035 

0.00012 

3.3(?) 

0.037(?) 

Eros 

217.94 

1.7610 


3.3(?) 

0.001(?) 

Jupiter 

777.6 

11.862 

316.94 

1,34 

2.64 

Saturn 

1425.6 

29.457 

94.9 

0.71 

1.17 

Uranus 

2868.1 

84.013 

14,66 

1.27 

0.92 

Neptune 

4494.1 

164.783 

17.16 

1.58 

1.12 

Pluto 

5937, 

247.7 

0.8(?) 




A Russell, H. N., Dugan, R. S., and Stewart, J. Q,, Astronomy, Boston, Ginn & Co., 1926. Data 
relating to Pluto have been taken* from other sources. 
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TABLE III 

An Example of the Functional Type op Table 
Some Properties of Compressed Hydrogen at 0° 


V 

V 

d 

p 

Cp 

Cy 

atm 

cmVniole 

gm/l 

atm 

cal /mole K° 

200 

' 

127.1 

15.86 ^ 

227.4 

7.07 

4.91 

300 

90.12 

22.37 

365.1 

7.14 

4.94 

400 

71.62 

28.14 

521.6 

7.19 

4.98 

500 

60.56 

33.28- 

699.2 

7.22 

5.00 

600 

53.19 

37.90 

900.2 

7.24 

5.04 


1 Peming, W. E., and Shupe, Lola E., Phys, Rev., 40, 850 (1932). 

2 The ssrmbol stands for fugacity. 


4. The Statistical Class of Tables. The general form of the statistical 
table and the names of its various parts are shown in the following plan: 


TABLE NUMBER 
Title 


Stub Heading 

‘ Box Heading 

Column Heading 

Column Heading 

Stub item 

Item 

Item 

Stub item 

Item 

Item 

Stub item 

Item. 

Item 

Stub item 

Item 



(a) The Title. The title of a table should describe its contents briefly. 
It should be clear, requiring no reference to the context. It should be 
complete, telling what is listed, the source of the data if not original or 
if not widely published already, and possibly the date and the scheme 
of classification. Such phrases as “A Table Showing the Relationship 
Between . . should ordinarily be omitted. If completeness must be 
sacrificed for brevity, the necessary descriptive material may be added 
as separate sentences in a headnote below the title proper or as a foot- 
note to the table. 
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(6) The Stub. The first column at the left, the stub, lists the separate 
categories or values of the assumed independent variable. Like all col- 
umns, the stub should have a descriptive heading naming the quantity 
listed and its units if expressed numerically. An exception is a stub that 
contains heterogeneous items not classifiable under a single class name. 

The choice of independent variable for tabulation is often arbitrary. 
When the stub is not quantitative the most appropriate order of enter- 
ing the discrete line headings depends on the purpose of the table. The 
alphabetical order is convenient for locating a particular heading. Some 
suggestions follow. 

1. Geographical, chronological, and magnitude subdivisions are 
often listed in the stub. 

2. Stub items within any subdivision of the stub or within the stub 
as a whole should be listed in some logical classified order based on 
geographical location, time, magnitude, or other qualification. 

3. It is usually easier to accommodate a long phrase in a stub than 
in a column heading. 

4. It is usually easier to accommodate a long list of values in a 
vertical column than in a horizontal line. 

(c) The Columns. Each column should have a heading naming the 
quantity listed and, if appropriate, the units used in expressing the values 
tabulated. Abbreviations or symbols should be used only when their 
meanings are clear. 

In many tables, certain of the column headings as a group represent 
subclassifications of a more general quantity named in a box heading. 
All such subclassifications should be both all-inclusive and mutually 
exclusive. 

(d) The Items. In the body of a table, numerical items should be 
arranged so that the decimal points are vertically aligned in each col- 
umn. Values expressed numerically should generally show zeros to the 
left of the decimal point in all uncertain places except that which con- 
tains the first uncertain digit. To the right of the decimal point a 
zero (0) as the first uncertain digit should not be omitted. Whenever 
the total for a group of individual items of one of the columns is given, 
it: should preferably appear at the top of the group. Note that a zero (0) 
entry may and should have a meaning different from that of a blank 
space. A blank space should mean that information is lacking, a zero 
that the item has zero value. * Sometimes a dash ( — ) is used to indicate 
that an item is negligible compared with the other items in the column. 
This is not desirable since it sometimes indicates lack of data. The 
question of significant figures is discussed under the functional table. 
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5. The Functional Class of Tables. In the functional table, correspond- 
ing values of the independent (x) and dependent (y) variables are listed 
side by side. .Every functional table should have a title which is clear, 
complete, and yet brief. Desired explanatory material, acknowledg- 
ment of source and references should follow. The form of the table is 
the same as that of the statistical table with the independent variable 
listed in the stub. Each column in the table should have a heading 
giving the name and the unit of the quantity listed. In the choice of 
the independent variable, Xj the functional table is usually less arbi- 
trary than the statistical table. The final decision must be based on the 
nature of the data and the purpose of the table. However, the variable 
so chosen should be a simple quantity, such as time, temperature, or 
distance, rather than a complex one such as might, be desirable in plot- 
ting the same data. If the complex quantity has some special signifi- 
cance its values may be listed in a separate column as one of the de- 
pendent variables. 

(а) Choice of the x-Interml. In constructing the table, one should 

usually (but not always) list rounded or otherwise convenient values of 
X in order of increasing (or, occasionally, decreasing) size, with succes- 
sive values differing by a constant amount. Ax, called the common 
difference or ic-interval. Since cr-values are rounded. Ax is usually 1, 2, 
or 5 multiplied by 10^^ where n is an integer. The particular value for 
Aa; in a given case usually represents a compromise between too small 
a value, which leads, to an unnecessarily long table, tedious to construct, 
and too large a value, which leads to too short a table and to too fre- 
quent and diiaacult interpolations in use. For purposes of summations 
and finding rates of change, the smaller the Ax, the more accurate the 
results. A reasonable type of exception to the above indicated equal 
successive difference listing is that in which the successive ratios of 
a::-values are constant. . 

(б) Smoothing the Data. For a table to be of greatest service the 
2 /~values corresponding to the tabulated a;-values should generally be 
smoothed or graduated; i.e., the successive variations in y with succes- 
sive equal variations in x should be made to vary gradually. In a truly 
statistical table, this smoothing process is without significance and 
should not be attempted. 

Given an unsmoothed table of values of 2 /==/(x), values for a 
smoothed table may be obtained (1) from an equation of y = f{x) 
which fits the data available, (2) from a graph of ^ = f{x) drawn to 
fit the data, (3) from an arbitrary, numerical procedure, or (4) from a 
graph of item differences. The two last-named methods involve tabu- 
lated values of x and 2 / in a regularly constructed but unsmoothed table. 
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If either of the first two methods is employed, the details of procedure 
and the results will depend somewhat on the smoother’s idea as to what 
the real y = f(x) is like; and a table thus smoothed may possibly be 
inferior to the unsmoothed table. Wherever the smoothing operation 
is carried through, it should always be with the purpose in mind of 
maintaining unchanged the general trend of the unsmoothed data and 
their approximate magnitudes. 

Where the relation y = f(x) is known, no smoothing process is in- 
volved. One is merely concerned with listing correctly computed values. 
Likewise, where an empirical relation has been found which maintains 
the general trend of the listed items as well as their approximate magni- 
tudes, the procedure, which now may be classed technically as smooth- 
ing, is similar and obvious. Methods for finding such empirical equa- 
tions are given in Chapter III. 

The second-named or graphical method of smoothing consists of plot- 
ting the available data, or perhaps only a portion at a time, fitting a 
smooth curve, and reading the smoothed ^-values therefrom. Plotting 
procedure is discussed elsewhere. 

Many methods characterized by arbitrary numerical procedure are 
possible. A method sometimes used is one based on a least-squares 
relation to be derived later. It assumes a constant value for Ax and a 
parabolic function for y =f(x). If carried through to a logical con- 
clusion, it will usually give satisfactory results. The method should 
not be used, however, unless over the range of four Aa;-intervals there is 
a reasonably close approximation to a parabolic relationship of the 
assumed type. The basic equation for this method is 

a = [ 172/0 + 12(2/1 + 2/-1) ■“ 3(2/2 + y-2)] [ 1 ] 

where 2/--2> Voi Vh 2/2 are five successive tabulated 2/-values and 
a is the smoothed value of 2/0 which should replace 2/0 hi the smoothed 
table. Actually inuch time and effort may be saved in applying Eq. 1 
if a temporary shift of origin to ( 0 , 2 /o) is made. In the new system, 
2/0 becomes 0 . Using a', 2 /'i, etc., for the new a and y items, Eq. 1 
changes to 

O'' = ~it [12 (2/^1 + 2/^—1) “■ 3 (2/^2 + 2/^—2)] [ 1 ^] 

of which the sums {y\ + 2 /'-i) and (2/^2 + 2 /' -2) will normally be small 
in magnitude. The a' obtained on this basis represents a correction to 
2/0 in the original coordinate system. 

Obviously the second-named method may on occasions be improved 
upon by smoothing also the item differences. This procedure, which is 
also applicable directly, is likely to be justified where the precision of 
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TABLE rV 

Illustratinq the Smoothing op Tabulated Data by the Smoothed Item- 

Differences Method 

The data of the first two columns, obtained by Jaeger,^ represent constant-volume 
atomic heats of platinum for various temperatures. All values for Cv and Ac„ 
are in cal/(gm-atom C°). Columns headed Ac'„ and represent the first 
and the second sets of approximations of smoothed values for iS^Cv as obtained 
from the graph of Fig. 1. Columns headed c% and c'% similarly represent approxi- 
mations to smoothed values for How well c'% is smoothed is shown by the 
column headed A^c"„; how well it represents the given values of Cr^ is shown by 
the column headed c'% — (See Table V for a first approximation in the smooth- 
ing of the same data by another method.) 


Tin ®C 

Cl} 

Acj} 

Ac% 

A^c'v 

C ^ 

Cv — Cv 

Ac'v 


C*^v 

c^^v — Cv 

100 

6,130 

0.120 

0.120 


6.130 

0.000 

0.120 


6.129 

-0.001 

200 

.250 

.105 

.108 

-0.012 

.250 

.000 

.108 

-0.012 

.249 

-.001 

300 

.355 

.099 

.096 

- .012 

.358 

+ .003 

.096 

- .012 

.357 

+ .002 

400 

.454 

.091 

.085 

- .011 

.454 

.000 

.085 

- .011 

.453 

- .001 

500 

.545 

.065 

.075 

- .010 

.539 

- .006 

.074 

- .011 

.538 

- .007 

600 

.610 

.068 

.066 

- .009 

.614 

-H .004 

.065 

- .009 

.612 

+ .002 

700 1 

.678 

.053 

.058 

- .008 

.680 

+ .002 

.058 

- .007 

.677 

- .001 

800 

.731 

.054 

.053 

- .005 

.738 

-h .007 

.053 

- .005 

.735 

H-. .004 

900 

.785 

.046 

.050 

- .003 

.791 

-j- .006 

.050 

- .004 

.788 

+ .003 

1000 

.831' 

.053 

.047 

- .003 

.841 

+ .010 

.047 

- .003 

.838 

+ .007 

1100 

.884 

.046 

.044 

- .003 

.888 

+ ,004 

,044 

- .003 

.885 

+ .001 

1200 

.930 

.039 

.042 

- .002 

.932 

+ .002 

.042 

- .002 

.929 

- .001 

1300 

.969 

.041 

.039 

- .003 

.974 

-1- .005 

.039 

- .003 

.971 

-f .002 

1400 

7.010 

.0^6 

1 

.036 

- .003 

7.013 

-1- .003 

.036 

- .003 

7.010 

.000 

1500 

.046 

.033 

.033 

- .003 

.049 

+ .003 

.034 

- .002 

.046 

.000 

1600 

-.079 

.029 

.031 

- .002 

.082 

+ .003 

.031 

- .003 

.080 

+ .001 

1700 

.108 




.113 

+ .005 



.111 

■f .003 

1755 

.124 

' 










^ Jaeger, F. M., Optical Activity and High Tempercdure Measurements, p. 371, New York, McGraw- 
Hill Book Company, 1930. 



THE FUNCTIONAL CLASS OF TABLES 


9 


determination of the listed values for the dependent variable is rather 
high. The procedure is best described by showing how it operates when 
applied to a special tabulation of unsmoothed data. For this purpose, 
we use Jaeger^s ^ values for the constant-volume atomic heats of plati- 
num for the temperature range 100° C to 1765° C (Table IV). 

The first step in the application of the item-differences method involves 
the determining of the differences Ac^,. These are plotted as in Fig. 1 



Fig. 1. Increments of constant-volnme atomic heats, Acp, of platinum (see Table IV) 
for 100 C° intervals as a function of temperature, for use in smoothing tabulated 
data by the successive approximation, tabular method. 

and a smooth curve is drawn to represent their means. Values of Ac'„, 
column 4 of the table, are taken from this curve and applied to some 
arbitrarily chosen recorded to give the first approximation to a 
smoothed set for As shown by the columns headed A^c'„ and 
- Co,, the first attempt at smoothing has yielded results which, 
though well smoothed, are generally too high in the region 600° C < 
T < 1700° C. Revision of the values recorded for Ac'«, stiU maintain- 
ing the principle that the values for Ac^^ need to be smoothed and 

I Jaeger, F. M., Of Heal Activity and High Temferdture Measurements^ p. 371, 
New York, McGraw-Hill h fok Company, 1930, 
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TABLE V 

Il/LtlSTBATING THE SMOOTHING OF TaBULA-TED DaTA BY THE LeAST-SQTJARES 

Method as Expressed by Eq. la 

The data of the first two columns obtained by Jaeger ^ represent constant-volume 
atomic heats for platinum. The units for 'A%, y', and a' are uniformly 

the cal/(gm-atom C°), (See Table IV where the same data have been smoothed 
by means of another method.) 


Tm°C 

Cv 

Aoo 


12(2/'i+2/'-i) — 3(y'2— 2/'-2) 

35a' 

C V ““ C'j) 

C 1} 

Ac'v 

A^c'u 

100 

6.130 

0.120 





6.130 

0.120 


200 

.250 

.105 

-0.015 




.250 

.106 

-0.014 

300 

.355 

.099 

- .006 

12(-0.006)-3(-0.035) 

+0.033 

+ 0.001 

.356 

.099 

- .007 

400 

.454 

.091 

- .008 

12(-0.008)-3(-0.048) 

+ .048 

+ .001 

.455 

.086 

- .013 

500 

.545 

.065 

- .026 

12(-0,026)-3(-0.057) 

- .141 

- .004 

.541 

.073 

- .013 

600 

.610 

.068 

+ .003 

12(-f-0.003)-3(-0.035) 

+ .141 

+ .004 

.614 

.061 

- .012 

700 

.678 

.053 

- .015 

12(-0.015)-3(-0.026) 

- .102 

- .003 

.675 

,058 

- .003 

800 

.731 

.054 

-h .001 

12(4-0.001) -3(-0.023) 

+ .081 

+ .002 

.733 1 

.050 

- .008 

900 

.785 

.046 

- .008 

12(-0.008)-3(-0.008) 

- .072 

- .002 

.783 

.050 

.000 

1000 

.831 

.053 

+ .007 

12(+0.007)-3(-0.001) 

+ .087 

+ .002 

.833 

.050 

.000 

1100 

.884 

.046 

- .007 

i 

12(-0.007)-3(-0.014) 

- .042 

- .001 

.883 

.046 

- .004 

1200 

.930 

.039 

- .007 

12(-0.007)-3(-0.019) 

- .027 

- .001 

.929 

.041 

- .005 

1300 

.969 

.041 

[+ .002 

12(4-0.002)-3(-0.008) 

+ .048 

+ .001 

.970 

* .039 

I - .002 

1400 

7.010 

.036 

- .005 

12(”0.005)-3(-C.011) 

- h27 

~ .001 

7.009 

.037 

.002 

1500 

.046 

.033 

- .003 

12(-0.003)~3(-~0.015) 

.009 

.000 

.046 

.033 

- .004 

1600 

.079 

.029 

- .004 




.079 

.029 

- .004 

1700 

.108 






.108 



1755 

.124 






.124 




^ Jaeger, F. M., Optical Activity and High Temperaiure Measurements, p. 371, New York, McGraw 
HjU Book Company, 1930. 
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keeping the differences c\ — in mind, may be made to yield a second 
approximation which is more satisfactory than the first. Such a second 
approximation is shown in the column headed How well the 
smoothing for the differences Ac-y and also for has been done is shown 
in the column headed That the smoothed values for retain 

closely the general trend of the original data, an important requirement 
for any satisfactory smoothing method, is shown by the column headed 

C 1) 

In practice, it is sometimes desirable to extend the process just de- 
scribed to the smoothing of second-order differences. Where the type 
of equation necessary to represent the data is not known and where the 
graph showing y = j{x) is not sufficiently precise, this method would 
seem to be among the best if not the best. 

For the sake of a comparison, the smoothing of the data on constant- 
volume atomic heats of platinum listed in the first two columns of 
Table IV is carried through in Table V according to the arbitrary- 
procedure method employing Eq, la. That the smoothed values thus 
obtained will maintain the general trend of the original data is evident; 
but, as shown by the columns headed A^c^ and A^c'-y, the smoothing 
produced by the first application is far from being as satisfactory as 
that produced by the item-differences method (see columns of Table IV 
headed A^c'^ and A^c^^,). Successive application of the method employ- 
ing Eq. la will certainly yield successive improvements; but the rate of 
approach to a satisfactory limit will generally be slow. This, added to 
the fact that it is helpless in smoothing the two values at either end, 
makes the method seem rather unsatisfactory for practical purposes. 

(c) Significant Figures, A significant figure is any digit of a number 
which is used to help denote the size of the number rather than to locate 
the decimal point. To illustrate, consider the following length measure- 
ments: 

(1) 123 cm 

(2) 0.00123 km 

(3) 12.03 cm 

(4) 12.30 cm 

^ (5) 12,300 cm 

Measurement (1) contains three significant figures. It indicates at 
most that the quantity is nearer 123 than 122 or 124 cm; i.e., that it 
lies between 122.5 cm and 123.5 cm. Measurement (2) also contains 
three significant figures. The two zeros to the right of the decimal 
point serve only to locate the decimal point. Values (1) and (2) are 
identical. 
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Measurement (3) contains four significant figures. Measurement (4) 
also contains four significant figures. Unfortunately, the exact signifi- 
cance of the final zero when written as. above is somewhat uncertain. 
At the most, it indicates that the quantity lies between 12.295 cm and 
12.305 cm. At the least, it indicates that the quantity lies between 
12.275 cm and 12.325 cm. In case the latter interpretation is correct, 
the next lower and the next higher values that might be recorded on 
the same basis are 12.25 and 12.35 cm, the least count being 0.05 cm. 
There is no generally accepted policy which enables the reader to tell, 
from the expression itself, precisely what was meant by the writer. In 
any case, recording a measurement as 12.3 cm when it may be justly 
written 12.30 cm suggests a precision less than that actually attained 
and indicates carelessness or ignorance on the part of the re- 
corder. 

Measurement (5) as recorded is ambiguous, since it does not indicate 
whether the length was measured to the nearest meter, the nearest deci- 
meter, or the nearest centimeter. For such quantities, when an indi- 
cation of precision is desired, use may be made of powers of ten, or of 
subdigits. Thus, if measurement (5) had been written as 1.230 X lO'^ 
cm or as 123oo cm, the uncertainty, except as noted in connection with 
measurement (4), would be removed. When written in the latter form, 
the small zero (o) farthest- to the left is understood to be the first uncer- 
tain digit. Accordingly, the two expressions of length have about the 
same meaning. 

For a table to be of greatest service, each value should contain neither 
more nor less than the number of significant figures it deserves. For the 
case of a:-values, there is no point in writing 300.00, 400.00, . . . rather 
than 300, 400, . . . , since the independent 3;-values are understood to 
be exact. For the ^/-values, however, the number of significant figures 
in each item is an indication of the reliability of the table. If the table 
is based on a theoretical equation, as are mathematical function tables, 
the possible number of significant figures is unlimited except for con- 
venience in construction and use. If based on an equation with experi- 
mentally determined constants, such as a table showing the radiancy, 
(R, of a black body as a function of temperature, T, where CR = 
the number of significant figures depends on the precision of the experi- 
mental constants, in this case tr. This principle also holds for an un- 
known law, as in a table showing the brightness of a black body as a 
function of temperature. 

There is no generally accepted rule for deciding the exact nximber of 
digits to record when tabulating a set of values of known precision. 
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The American Society for Testing Materials gives rules ^ which gen- 
erally result in a number containing two doubtful digits. They state, 
however, that for some purposes it is satisfactory to drop all digits 
uncertain by more than about 15 units. A value recorded as 34.7, then, 
may lie at best between 34.55 and 34.85, or at worst between 33.2 and 
36.2. If the first set of limits is known to have too great a separation, 
another significant figure is permissible; or if the second set is still too 
small, the number should be rounded to 35. This is the practice which 
the authors are inclined to favor. Still another practice consists of 
retaining the last figure uncertain by less than 10 units. Then 34.7 
would mean a value between 34.6 and 34.8 at best or between 33.7 and 
35.7 at worst. Sometimes the uncertain digits are printed inferior, e.g., 
34 . 7 . A discussion of what is meant by the precision of a value may 
be found in Chapter VII. 

(d) Rounding Off Numbers. If a number is to be rounded to a specific 
number of significant figures the following rules ^ should be observed : 

1. If the first digit to be dropped is less than five, the last digit 
retained is left unchanged. 

2. If the first digit to be dropped is greater than five, or is five 
followed by digits greater than zero, the last digit retained is increased 
by one. 

3. If the digit to be dropped is five followed by zeros only, the number 
is rounded to its nearest even value. 

Thus, rounding to one decimal place, 

12.345 yields 12.3 
12.367 yields 12.4 
12.356 yields 12.4 
12.350 yields 12.4 
12.450 yields 12.4 

(e) Abbreviated Forms of Tabulatim. Within the limits of space which 
may be accorded them, tables should be so constructed that a desired 
quantity may be obtained with the greatest ease. Doing so necessitates 
not only the observance of the general policies set forth above but also 
certain procedures for certain special cases about to be presented. Tor 

14933 A.S.T.M. Manual on PresmUUion of Data, p. 44, Second Printing, March 
1937, A.S.T.M., Philadelphia. 

iThese rules are slightly difEerent from those recommended by the A.S.T.M. 
Manual on Presentation of Daia, -p. 4A. 
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the most part, these procedures concern abbreviated forms of expres- 
sion, and, in addition to making it easier for the user of a table to find 
desired material, save in space and in printer's ink. Five such special 
cases will be considered. 

1 . Given that all .values for a variable are fractional and that, when 
written decimally, they have digits other than zero in the 'first or 
second place to the right of the decimal point, the customary policy 
is to list a zero in the units place for the first value of a column of 
values but not in the succeeding values of that column. See Tables 
I and II of Appendix 2. Often even the zero for the initial value is 
not listed. 

2 . Given, as a variation of the first case, that the first significant 
digit, particularly if occupying the first place to the left of the decimal 
point, varies only occasionally, a common practice consists in re- 
cording that significant digit for the value at the top of the column, 
leaving the corresponding position vacant for all following values until 
a change in that digit occurs, recording the new digit and proceeding 
as before. Table IV of this chapter contains two such illustrations, 

3. For cases where the values for a variable are expressed in terms 
of 10 "^^ or 10 "“^ of what is considered a satisfactory unit, two pro- 
cedures are rather common, (a) According to one procedure a column 
heading is often written in an appropriate corresponding form.. , See 
Table II of Chapter Vll. ( 6 ) According to the other procedure, the 
first value in a column is sometimes written as, say, O.O 5 OIO provided 
that all values for the column agree in having zero in each of the first 
five places to the right of the decimal point. Other values, properly 
aligned, then include only three digits each to correspond to the 010 
of the first value. 

4. Given that all values to be listed in a column are given with 
several significant figures of which only a few vary throughout the 
column, two procedures are common, (a) According to one procedure, 
that which is listed is the difference be.tween actual values for the 
variable and some rounded convenient value. See Table III of Chap- 
ter VII, where only those portions of velocities in excess of 299,000 
km/sec are recorded. ( 6 ) According to the second procedure, a com- 
plete value is recorded for the first of the column only. Succeeding 
values will include digits only in places where variations occur in the 
column. Thus, as such succeeding values for the first column of the 
table just referred to, we might have 299,728, 733 , 738, . . . , 818, 
and 823. Of course, the final digits for all values must fall in the 
same vertical line. 
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5. The last case to be named concerns quantities that usually have 
the same number of significant digits but which vary considerably in 
order of magnitude. A common custom here makes use of powers of 
ten. The details of application will naturally vary with the author. 
In Tables VII and VIII of Appendix 2^ the power of 10 is indicated 
by the number enclosed in parentheses. Thus from Table VIII, we 
see that ^2 for n = 6 is 14,285,714 X 10“^ and that k 2 for n = 40 
is 46,904,315 X 10“"^^. 

(f) Tabular Differences. The successive tabular differences of the 
^/-variable are of importance in certain interpolation methods and in 
testing the type of relationship between y and x. The first difference, 
denoted by the symbol A, is defined by the equation 

A2/n = 2/n+i - Vn [2] 

Higher order differences, A^, A^, etc., are similarly defined: 

A V == ^Vn+l - A^/n == yn +2 ““ + Vn [3] 

A yn = A 2/n-i-i A 2/u ~ 2/714.3 32/u 42 “f" 32/7141 Vn [4] 


Such successive differences are often arranged as in Table VI. 

TABLE VI 


Illusteating the Usual Fokm of the Diffeeence Table 
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A numerical example is given in Table VII. 

TABLE VII 

Illttstratinq the Method of Constbucting a Difpebencb Table 

[Note that since s- and 2 /-values are related by the equation j/ * 1 -{- 3a; -f- 3 A all differencea of the 
third and higher orders vanish.] 



6. Interpolation. There are numerous interpolation procedures for 
finding intermediate ^/-values corresponding to a given oj-value in the 
range of a particular table. The appropriate procedure depends on the 
accuracy of the table, the type of relationship presented, and the pre- 
cision desired. One or another of the simpler methods given below will 
ordinarily serve for most purposes. Other methods may be found in 
more advanced texts.^ 

(а) The Graph Method. Finding by interpolation a y corresponding 
to a given x, Xn say, necessitates four steps: (1) selecting from the table 
certain convenient corresponding values of x and y in the region of Xn, 
(2) plotting these values on ordinary cross-section paper, (3) drawing 
the best curve to express y = f{x), and (4) reading the desired y^ from 
the curve. Depending on the number of points plotted, the openness 
of the scales selected, and the care used in plotting and drawing the 
curve, this method may be used to give poor, moderate, or highly accu- 
rate mterpolations. Unless the table is very detailed, a worker recjuir- 
ing frequent interpolations from a given table will ordinarily make such 
a graph and use it thereafter to the practical exclusion of the table. 
The principles of plotting data are treated in the following chapter. 

(б) The Proportional Part Method. When interpolations are to be 
made from a given table only occasionally, or when graphing is not 

1 Whittaker, E. T., and Robinson, G., The Calculus of Observatiom, Chap. I 
London, Blackie & Son, Ltd-, 1924. ^ 
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practicable, numerical methods can be used. Of these, the proportional 
part method is the simplest. It assumes that between tabulated values 
of X, y varies linearly with x. Using this method, the 2/-value corre- 
sponding to a given x lying between two successive tabulated points, 
{xi,yi) and (0:2, 3/2) is obtained from 

y = yi + ^-^^{x-x{) [5] 

(c) The Gregory-Newton Method, This method is longer but more 
accurate than the proportional part method. It is based on the assumed 
relation 

y == A+Bx + Gx^ + Dx^ [6] 

containing unknown constants A, B, C, etc. It is derived as follows. 
Referring to Table VI, it is seen that 

2/1 = 2/0 + A2/0 

2/2 = 2/1 + ^yi = 2/0 + 2A2/0 + A^ 2 /o 

2/3 ~ 2/2 + A2/2 = 2/0 + SAt/o + 3 A^ 2 /o + A^ 2 /o 


In general, it is evident that for integral values of n, 

. . . 1) a2 . 

2/n = 2/0 + ^At/o H — Ayo + 


”” 1) a2 . - 1)(^ ““ 2) ^3 , 

J A^2/o H [7] 


2! 


3! 


where n = (x -- xo)/AXj and in which the coefficients of the A^s are 
those of the binomial theorem. Provided Eq. 6 is fulfilled, it may. be 
shown that Eq. 7 holds for all positive values of n, fractional as well 
as integral. It gives directly the y corresponding to any given x in 
terms of a neighboring tabulated basic value, 2/0 (usually the nearest 
smaller value), and the successive differences, At/o, A^yo, etc. The re- 
striction of Eq. 7 to positive values of n does not prevent its use for values 
of X less than xq. It is then necessary to consider the table in order of 
decreasing values of x, whereupon Ax is negative. However, n remains 
positive. 

In general, Eq. 7 is an infinite series. Usually, however, and espe- 
cially when Ax is small, the. terms of the higher orders are negligible in 
comparison with the first few terms, so that the formula is ordinarily 
practicable. The exact number of terms to be used depends on the par- 
ticular case at hand. Note that if the terms beyond that containing 
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disregarded, we have the formula for the proportional part 

method. 

Illustrating the use of Eq. 7, let us determine the value of the proba- 
bility integral, 

Phx. = f d(Jix)^ [7a] 

'V T Jo ' 

corresponding to hx = 0.97, by interpolation, using data given in the 
first two columns of Table VIII. Using 1.00 as the basic te-value, the 


TABLE VIII 

Data and Computations for Determining a Probability by the Gregory- 
Newton Interpolation Method 


htC 

Phx 

APhx 


A^Phx 

1.00 

0.84270 

- 0.04579 



0.90 

0.79691 

- 0.05481 

- 0.00902 

- 0.00047 

0.80 

0.74210 

- 0.06431 

- 0.00949 

- 0.00015 

0.70 

0.67780 

- 0.07394 

- 0.00964 


0.60 

0.60386 





a;o of the preceding discussion, and “0.10 as Ate, n becomes 0.3 and we 
obtain for Po .97 or, from the standpoint of Eq. 7, for yo.sj 


Po.97 = 0.84270 4- 0.3(-0.04579) + ^ (-0.00902) + • • • 

= 0.84270 - 0.01374 + 0.00095 - 0.00003 + • ■ • [8] 

= 0.82988 

The value obtained, 0.82988, is greater by 0.00001 than that generally 
reported. It is much more precise than the value obtained by the pro- 
portional part method, namely, 0.82896, which is given by the first two 
terms of the right-hand member of Eq. 8. 

(d) The Equation Method. This method Consists in finding an em- 
pirical equation, y -J{x), to fit eertam selected tabulated values of x 
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and y, substituting therein the given value for and solving for the 
desired y. The particular type of equation to select will depend on the 
nature of the table. Ordinarily, the power series, 

y — A + Bx + Cx^ + • [9] 


suffices. For sufficiently small ranges, only three terms are necessary. 
Constants A, 5, and C may be determined to yield an equation that 
will pass through any three selected points, {xi^yi), and 

As such points, the three nearest the given x are usually chosen. In 
determinant form, the desired equation is 


y 

1 

X 

X^ 

yi 

1 

Xi 

Xi^ 

2/2 

1 

X2 

X2^ 

2/3 

1 




Eq. 10 may be reduced to the form of Eq. 9 if values for A, jB, and C 
are desired. If not so desired, we may substitute an appropriate value 
for x directly in Eq. 10 and solve the determinant for the desired y. 
Where the intervals X 2 — Xi and Xz — have the same value Ax, 
much time may be saved by changing the origin of coordinates as from 
(0,0) to (x 2 , 2 / 2 ). Representing the new coordinates by x' and t/' where 



X — X2 
“ Ax 

[11] 

and 

1 

11 

'5ft 

[12] 

we have 

11 

II 

> I 

II 

1 

[13] 


, X 2 -X 2 ^ 

X'2= . =0 

Ax 

[14] 


Xz - X2 , 

x'z- ^ =1 

Ax 

[15] 


y'l = vi- y 2 , etc. 

[16] 
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In the new coordinate system Eq. 10 becomes 

1‘ x' 

y'l 1-11 
0 10 0 
y's 1 11 

which reduces at once to 

?/' x' x'^ 

y\ -I 1 =0 [18] 

y's 1 1 

Eq. 18 may be quickly solved for y'j and y may then be obtained by 
adding 2 / 2 * 

To illustrate the use of Eq. 18, consider the problem of the previous 
section. Representing hx by x and P by y, the necessary tabulated data 
in terms of the original and the shifted coordinate systems become 

X y . x' y' 

(hxY (P) 

0.80 0.74210 ~1 -0.05481 

0.90 0.79691 0 0 

1.00 0.84270 1 0.04579 

For X — 0.97, x' = 0.7. Substitution in Eq. 18 yields 

y' 0.7 0.49 

-0.06481 -1 1 =0 [19] 

0.04579 11 

from which y' = 0.03300, and y = 0.82991. This value is greater than 
that usually reported by 0.00004. 

Although it has been assumed in the foregoing that there is a common 
x-interval, such is not necessary. The procedure for this infrequent 
case is left to the reader, 

Eqs. 18 and 19 give the same interpolation as the Gregory-Newton 
formula, with the terms beyond that containing the second difiFerence 
omitted. 

(e) The Lagrange Method. This method is of particular importance 
because it can be used to find the ^/-value corresponding to a given 
x-value when, instead of a formal table, we have simply a group of corre- 
sponding X- and ^/-values not separated by the common difference, Ax. 
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The Lagrange interpolation formula assumes that y may be expressed 
as a fimte power series in rc, as in Eq. 9, namely 

y=^A+Bx + Cz^+^^^ [9] 

If the determinant of Eq. 10 or a similar one, containing more terms if 
desired, is expanded to express y in terms of yi, ^3 * * * and the de- 
terminant minors F, Fi, F 2 , F 3 *•*, one obtains directly 

El F2 Fg 

2/ = 2/1 — - 2/2 — + 2/3 — [ 20 ] 

1 1 Y 


Expansioa of the minors leads to the standard Lagrangian form of 
equation, namely 


2 / = 2/1 


{x — rro) 

. {xi - X2) 


X 


- 3 : 3 ) 

(Xi - Xs) ^ 


(x — X4) 

r — 

(Xi - X4J 


(x-xs) 

{xi - X5) 


+ 2/2 


(x - Xi) 
-(X2 - Xi) 


X 


(x - 3 : 3 ) 

(X2 - 2 : 3 ) 


X 


(x - X4) ^ (x-Xs) ^ 

{X2 - X^ (X2 - 2:5) 


[20a] 

+ ... 


There are as many terms as there are points used in the interpolation. 

To illustrate, suppose it is desired to find the current which will heat 
to 2500° K, in vacuo, a long tungsten filament whose radius is 0.062 mm. 
From a list of tabulated values, we find, for instance, that the currents 
for wires with radii of 0.030 mm, 0.050 mm, 0.080 mm, and 0.100 mm 
are 0.690 amp, 1.485 amp, 3.000 amp, and 4.200 amp, respectively. It 
follows, from the Lagrange formula, in case, for convenience, we use the 
micron values for the filament radii, that 


I&2 


0.690 amp 


"62 - 50 62 - 80 62 - 100“ 
.30 - 50 30 - 80 30 - 100. 


+ 1.485 amp 


“62 - 30 62 - 80 62 - lOO' 
.50 - 30 50 - 80 50 - 100. 


+ 3.000 amp 


“ 62 - 30 62 - 50 62 - 100 “ 
.80 - 30 80 - 50 80 - lOO. 


+ 4.200 amp 


62 - 30 62 - 50 62 - 80 
.100 - 30 100 - 50 100 - 80. 


= (-0.0809 + 1.0835 + 1.4592 - 0.4147) amp 
= 2.047 amp 


[ 21 ] 
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This is very close to the 2.048 amp predicted by the % power law for 
the condition of constant temperature, namely, 


'h 

.h 



[ 22 ] 


It is interesting to note that, with the separate omissions of terms in- 
volving the 0.030 mm and 0.100 mm wires, the values obtained for 



Fig. 2. Grapii showing possible dangers in assuming without testing that a simple 
power series expressing y in terms of x holds when the values for Aa; vary consider- 
ably. The increments of curves A and B between points of crossing are much more 
nearly equal than those for curves A and C, Between the limiting points of cross- 
ing, the former pair gives more nearly the same loci of points than the latter pair. 

10.062 are respectively 2.045 amp and 2.051 amp; and that, when the 
terms involving these two wires are omitted simultaneously, the pro- 
portional part value of 2.091 amp is obtained, as is to be expected. 
Any number of corresponding I and r values may be substituted in 
Eq. 20. As might be expected, the terms involving the wires nearest 
the given wire in size are the most important in determining the desired 
current. 

Although intended principally for use where the a:-intervals are non- 
uniform, the Lagrange method applies equally well to interpolations 
from a formal table with a constant Ac. 
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In the application of methods based on the empirical power series 
forms of Eqs. 6 and 9, one needs to consider certain possibilities for 
trouble, particularly where the Ao^-intervals differ considerably. To il- 
lustrate, the points (0,0), (4,2), and (16,20) not only satisfy the equation 


but also the equation 


X , X 

^ = 4 + 16 


15 15 


[23] 

[24] 


How great is the danger in interpolating m these two cases is shown in 
Fig. 2, where both equations are graphed. If, however, the values for 
Ax and for Ay are separately of the same order, there is not the same 
great danger in the selection of the wrong power series. Thus for the 
points (0,0), (8,6), and (12,12), we have the two equations 

X x^ 

‘'"i + Fe 

and 

% 

3 18 

As shown also in Fig. 2, the plot of Eq. 25 will generally yield interpo- 
lated values for y which are not so greatly different from those obtained 
using Eq. 23. 

(/) The Taylor^ s Series Method, The usefulness of this method is lim- 
ited to tables based on a known transcendental equation. For such 
tables the method gives good results. In accord with Taylor’s series, 
the interpolation formula is 

y = f{x) = f{xQ + bx) 

= /(a:o) + ^ H [26] 

where Sx = x -- xq and the primes indicate differentiation with respect 
to X. 

It suffices (1) to select from the table an xq as near as possible to the 
given Xf (2) to form /'(%), etc., and (3) to insert those values, 

together with the appropriate dx into the formula to obtain the desired y. 
Suppose it is desired to find the value of In a table, we find 

for and the values 335 X 10”® and 123 X 10”®. Applying 


[23] 

[25] 
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the Taylor’s series method, we have in turn 

fix) = -e- 
f'(x) = e-*, etc. 

Sx = 8.2 - 8.0 = 0.2 

whence 

y = e-8.2 = e-8.0 _ e-8.0 + e"®'® — 

= e“® ° (1 - 0.2 + 0.02 - 0.0013 + 0.00007 • • •) 

= 335 X 10“® (0.8188) = 274 X 10“® [27] 

The value obtained is as precise as the value given for 

7. Extrapolation. When the value of y is desired for an x outside the 
range of values covez'ed by the data, we must resort to extrapolation. 
In method, extrapolation and interpolation are alike; any of the inter- 
polation procedures described above may be used for extrapolating. The 
chief diJEferences lie in the accuracy of our results. 

Where the law stating the dependency of y upon x is known, no 
difficulty is experienced in either interpolation or extrapolation. All 
methods, except the simple proportional part method, may be used 
with equal safety even if not with equal ease if the range of extrapola- 
tion is not too great. However, the equation and the Taylor series 
methods are then particularly applicable. Generally such determina- 
tions are not regarded as extrapolations. Where nothing of the law of 
variation is known, beyond the range for which tabular values are given, 
extrapolations represent little more than guesses which have a certain 
amount of reasonableness. Where something of the law of variation is 
known, extrapolations take on increased probabilities as to correctness. 
As a result certain extrapolations can be made with a degree of certainty 
which is rather high. To illustrate, the brightness of carbon at tempera- 
tures above its normal sublimation point, such as are realizable under 
pressure, has not been determined experimentally nor is its law of varia- 
tion known. Knowing, however, that the radiations from carbon are 
subject to certain laws of thermodynamics permits one to set certain 
upper and lower limits within which extrapolated brightnesses for the 
carbon must fall. 

8. Summary. The table, one of three forms for presenting data, lists 
corresponding values or properties of the dependent and independent 
variables in an orderly arrangement. Tables are simple and inexpensive 
to construct, easy to use, and compact. 
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There are three classes of tables: the qualitative, the statistical, and 
the quantitative or functional. The principal parts of the statistical 
table are the title, the stub, colunan headings, and items. 

The functional table is similar to the statistical in form, but lists ' 
corresponding values of dependent, y, and independent, x, variables. 
Values of x differ commonly, but not always, by a constant amount. 
Preferably 2 /- values should be smoothed. Depending on circumstances, 
this may be done (1) by taking corresponding values from an equation 
that represents the data, (2) by taking corresponding values from a 
graph in which a smooth curve has been drawn to represent the data, 
(3) by applying corrections obtained by an arbitrary mathematical pro- 
cedure such as is connected with Eq. la, or (4) by smoothing the item 
differences, applying such differences to obtain an approximate smoothed 
tabulation and finally adjusting to obtain a tabulation which maintains 
also the general trend of the unsmoothed tabulation (Table IV and 
Fig. 1). Except where the law of variation in equation form is known, 
the last-named procedure is obviously best. 

The precision of tabulated data should be indicated by the number 
of significant figures in the items. Generally the last digit of an item 
should be the first deemed uncertain digit unless the uncertainty is of 
the order of 1 3 ^ or less, in which case a second uncertain digit — either 
a zero or five, whichever seems closer to the true value— is permissible. 
Some prefer not to round off these last digits. 

In rounding off numbers, the last digit retained is left unchanged or 
increased by one as the amount dropped is less than or in excess of 0.5 
of a unit in the last place retained. If the amount dropped is just 0.5 
of a unit, the last digit retained is made an even digit by leaving it 
unchanged or by increasing it by one if necessary. 

In using a table, interpolation is often resorted to for finding the y 
corresponding to a given x for intermediate values of x. Interpolation 
may be done graphically by fitting a smooth curve to the tabulated data 
and reading y from the curve. A second method is the proportional 
part method, where 

y = 2/1 + (a: - %) [5] 

X2 r- Xi 

and (xi,2/i) and {x 2 ,y 2 ) are successive tabulated points such that 
Xi < X < X 2 . The Gregory-Newton interpolation formula is 

y = Vo + nAyo + — -j - A%o-\ [7] 

where (xo^yo) is the tabulated point nearest {x,y) and n = (x — xq)/Ax. 
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The equation method consists in selecting three tabulated points 
{Xi,y 2 ), and {xs,yz) nearest (x,y), shifting the origin and changing co- 
ordinates by means of the substitutions 


,/^y-y, [ 12 ] 

substituting values of y'l, y'z, and x' in the determinant equation 

y x' x'^ 

y'l —1 1 =0 [18] 

y's 1 1 

and solving for y' and then y. The Lagrange formula, Eq. 20, is useful 
for interpolating from a list of values not arranged in a formal table. 
The Taylor’s series method, Eq. 23, gives good results for tables based 
on a known transcendental equation. 

Tables may be extrapolated by applying interpolation procedure to 
values of x outside the range of the tabulated ic-values. Except where 
the law relating y and x is known, such extrapolations are only approxi- 
mate at best. Extrapolations for values of x just beyond the limit of a 
table are safer than those for values considerably beyond the limit. 


PROBLEMS 

1. The following table is a portion of a table representing the results of an extended, 
important .study of air by Roebuck.^ It shows the Joule-Thomaon efl’eot m of air 
expressed in C°/atm as a function of temperature T and pressure p. 


\ Tin 
\ °C 
PinV 
atm \ 

0 

50 

100 

150 

200 

250 

1 

0.2746 

0.1956 

0.1355 

0.0961 

0.0645 

0.0409 

20 

.2577 

.1830 

.1258 

.0883 

.0580 

.0366 

60 

.2200 

.1571 

.1062 

.0732 

.0453 

,0254 

100 

.1822 

.1310 

.0884 

.0600 

.0343 

.0165 

140 

.1446 

.1070 

.0726 

.0482 

.0250 

.0092 

180 

.1097 

.0829 

.0580 

.0376 

.0174 

4* .0027 

220 

.0795 

.0609 

.0449 

.0291 

.0116 

- .0025 


^ Roebuck, J. R., Proc. Am. Acad. Arts Sci., 60 , 537 (1925), as corrected by the original author. 
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Tins table may be improved by smoothing both as to pressure and as to temperature. 
Smooth as to variations in pressure. When so smoothed, note whether there seems 
to be need for further smoothing as to temperature. 

2. The fractional voltages and candle powers of vacuum tungsten lamps in terms 
of their normal voltages and candle powers at 2450® K as a function of temperature 
has been reported ^ as follows: 


'in °K 


^in % 
1 % 

2000 

55.0 

10.4 

2100 

63.6 

18.6 

2200 

73.3 

32.2 

2300 

83.5 

52.2 

2400 

94.3 

81.4 

2450 

100.0 

100.0 

2500 

105.9 

122.0 

2600 

118.5 

179.3 

2700 

132.3 

257.0 


Form a new table with smoothed values, maintaining the values as 100.0% for 
2450® K. Note that end values are as liable to err as are other values. For smooth- 
ing the ///n values, consider a curve sho^^dng A log J//n as a function of T. 

3. Derive Lagrange's interpolation equation. 

4 . For the molal heat of air at a pressure of 20A, Roebuck ^ gives the following 
values as a function of temperature. 


T Cp 

- 100° C 0 . 2757 cal/ (mole K®) 

- 75 .2630 

- 50 .2556 

- 25 .2514 

0 .2492 

-h 25 .2487 

+ 50 .2480 


T Cp 

-h 75° C 0 . 2475 cal/(mole K°) 

100 .2470 

150 .2466 

200 ,2463 

250 .2468 

280 .2471 


Determine the values of Cp for air at 20A and +40® C, — 20® C, and — 60° C. 

6. The spectral transmittances of a 6 mm thick, 28%, Corning high-transmission 
red glass as reported in a graph by Fors 3 d;he are: 

X 0.63 /t 0.64 0.65 0.66 0.67 0.68 0.69 0.70 0.71 0.72 0.73 0,74 

t 0.00 0.02 0.25 0.60 0.735 0.770 0.770 0.765 0.760 0.750 0.745 0.735 


Determine the transmittances at 0 . 655 ji and 0.665 ju. 

1 Forsythe, W. E., and Worthing, A. G., Astrophys. 61 , 152 (1925). Values for 2400°K adjusted. 
^ Roebuck, J. R., Proc. Am. Acad. Arts Sci., 64 , 287 (1930). 
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6. For the variation in relative spectral brightness at 0.534 /x from center to limb 
of the sun’s disk, Abbot ^ of the Smithsonian Institution gives the following data: 


0.00 

0.40 

0.55 

0.65 

0.75 

0.825 

0.875 

0.92 

0.95 

463 

440 

417 

396 

366 

337 

312 

281 

254 


oB\ 

Determine, by the proportional part, the graph, and the Lagrange methods, the 
relative spectral brightnesses at r/a — 0.20 and r/a = 0.80. When graphing, choose 
the scales so that the line drawn makes an angle of roughly 45° with the coordinate 
axes. ' 

7 . Using the data of Problem 6, extrapolate to determine a relative spectral 
brightness for 0.534 jj. at r/a ~ 0.98, using a combined graph and Gregory-Newtoii 
method and the Lagrange method. 

8. Smooth the following tabulation of spark-potentials between 75-cm (diameters) 
spheres in air with the positive sphere grounded as a function of sphere separation. 


Gap 

Sparking 

Potential 

Gap 

Sparking 

Potential 

5 cm 

137 kv 

35 cm 

720 kv 

10 

263 

40 

775 

15 

382 

45 

825 

20 

483 

50 

870 

25 

573 

55 

908 

30 

650 

60 

937 


Handhuch der Physik (Geiger and Scheel), 16 , 407 (1927), via Hoag’s Electron and 
Nuclear Physics, 461 (1938).] 

9 . Koch has reported the following values for y the ratio of the two specific heats 
of air at 0° C and various pressures. All values are based on Roentgen’s 1873 de- 
termination of 1.4053 for lA and 0° C. . Smooth the tabulated values. 


Pressure y Pressure y 


1 A 

1.4053 

125 A 

1.690 

25 

1.473 

150 

1.739 

50 

1.530 

175 

1,783 

75 

1.593 

200 

1.828 

100 

1.646 




10. The following table of heats of vaporization of water for various temperatures 
taken from a well-known source shows need of smoothing. Form a smoothed table. 


T 

L 

T 

L 

T 

L 

■°C 

cal/gm 

°C 

cal/gm 

' °C 

cal/gm 

0 

596.4 

70 

556.9 

140 

611.5 

10 

590.2 

80 

551.1 

150 

504.1 

20 

584.9 

90 

544.9 

160 

496.5 

30 

579.6 

100 

538.7 

170 

488.7 

40 

574.2 

no 

532.3 

180 

480.6 

60 

568.4 

120 

525.6 

190 

472.3 

60 

562.8 

130 

518.6 

200 

463.8 

1 Abbot, C. G.. 

The Sun as 

a Source of Continuous Radiation, p. 

76 of Measurement of Radiant 


Energy, Ed. by W. E. Forsythe, New York, McGraw-Hill Book Company, 1937. 
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REPRESENTATION OF DATA BY GRAPHS 

1. Introduction. The graphical method of presenting data is an 
adaptation of the principles of Descartes’ analytic geometry, whereby 
numerical values are represented in geometrical form by the length of 
a line, the area of a surface, the volume of a solid, or the rotation de- 
scribed by an angle! The fact that aU measurable quantities may be 
given such representation does not mean that all data should be plotted. 
For certain data a graph means little more than wasted time and labor. 
For other data, failure to graph results not only in a loss of time and 
energy, but also in a failure to perceive significant relations. A decision 
as to whether or not to plot must be trusted to one’s common sense. 

In this chapter we set forth the general advantages and purposes of 
graphical representation. Examples and illustrations are given, first of 
the simple qualitative type, then of the more important quantitative 
type. Finally, specific suggestions and rules are stated for the con- 
struction of graphs of the latter type. 

2. Advantages of Graphs. In favor of graphs generally, it may be 
said that (a) they facilitate comparisons of values, (6) they appeal to 
the attention of a reader, (c) they permit easy reference to data, and (d) 
they provide a compact form for filling. In addition, most graphs will 
reveal readily the presence of maxima, minima, critical inflection points, 
unusually high or low rates of change, and periodic or other significant 
features in a set of data, whereas otherwise certain of these features 
may be either overlooked entirely or seen only after a rather careful 
survey of the tabulated data. Further, with the aid of a graph, one can 
often determine whether or not a relationship exists between the two 
variables being considered, and sometimes, if a relationship exists, its 
mathematical form. Still further, if a satisfactory curve can be drawn, 
one may differentiate or integrate one variable with respect to the other 
directly from the graph without knowledge of the mathematical form 
of the relation represented. These advantages warrant a somewhat de- 
tailed study of graphs. 

3. Purposes of Graphs— QuaEtative and Quantitative. A graph may 
generally be classed as belonging to one or the other of two groups, 
depending on the main purpose it is to serve. Those of the first group 

29 
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are designed primarily to present a qualitative picture of a process (e.g., 
the growth of population in the United States) or of a condition (e.g,, 
the sizes of the available armies of the European nations in 1939). 
Graphs of the second group are intended primarily as quantitative tools 
in operating and controlling mechanisms and methods or as guides in 
research. Commonly both purposes are served by a single graph, though 
usually one or the other predominates. 

4. The Qualitative Graph. Of the qualitative graphs, we have those 
in which there is represented: (a) one variable, y, as though a function. 



^ Fig. 1. Examples of two types of qualitative graphs showing their characteristic 
differences. (Data from 16th Census of the U./S., 1940, Series P-3, No. 21, Nov. 15, 
1941.) 


f(x), of the other variable, but actually without any suspected causal 
connection other than that of a simultaneity in time, coincidence in 
location, etc., and (b) y = f{x) with a known or suspected causal con- 
nection between the variables. The graphs of Fig. 1 illustrate some of 
the differences between the two groups. Graphs (J.) and {B) are both 
plots of the same data. In (A) the relative populations at the ends of 
succeeding decades are emphasized. In (J5) it is assumed that popula- 
tion and time are somehow related and emphasis is placed on this rela- 
tion. Both (A) and (jB) belong to the qualitative class of graphs, for 
though (JS) is of the type most commonly used as a tool, it is not in- 
tended nor is it, in many respects, able to serve any of the uses men- 
tioned in the following section. It is seen (1) that (A) is a more striking 
presentation than (S), though the latter shows the rate of growth more 
clearly; (2) that plotted values of population can be read more quickly 
from (A); and (3) that {B) permits more accurate interpolations and 
extrapolations, uses commonly associated with the quantitative graph. 
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(A), A stepped line graph showing average rainfalls in Pittsburgh for the different 
months of the year for the interval 1880 to 1930. (Report of the U. S. Weather 
Bureau.) 



Atomic Number 


(B). A broken line graph showing the atomic volumes of the elements as a function 
of their atomic numbers. (XJnw. of Pittsburgh, Atomic Physics, 2nd Ed., p. 190, 
New York, John Wiley & Sons, 1937.) 

Fig. 2. Four types of qualitative line graphs. 
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(C). A smooth line graph showing losses of mass sustained in the synthesizing of the 
different types of atoms from the simpler atoms. {Univ. of Pittsburgh, Atomic 
Physics, 2nd Ed., p. 45, New York, John Wiley & Sons, 1937.) 



(D). A variation-from-the-mean line graph showing deviations with time at four 
American cities of the average autumn temperatures (strictly 20 year moving 
averages) from the mean autumn temperature for the 100 year interval 1837 to 
1939. {Kincer, J. B., Temperature Distribution, Extremes, and Trend Tendencies 
Over the Earth^s Surface, from the symposium entitled Temperature, Its Mmsure- 
meni and Control in Science and Industry, p. 355, New York, Reinhold Publishing 
Corp., 1941.) 

FlO, 2* Four types of qualitative line graphs. — Continued, 
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Tensile Strength in Ibs./in? 

0 200,000 400,000 600,000 

Tungsten 
Steel . 

Nickel 
Tantalum 
Copper 
Platinum 
Aluminum 
Tin. 



(A). The approximate maximum tensile strengths of wires of various metals. {Hand- 
book of Chemistry and Physics, 26ih Ed., p. 1629, Cleveland, Chemical Rubber 
Publishing Co., 1942.) 


Death Rate per 100,000 Population 

Cause of Death 0 10 20 30 40 



(jB). The leading causes of death at the age of eleven, the age of lowest mortaKty. 
{Metropolitan Life Insurance Co. Statistical Bulletin, Nov. 1936.) 

Fig. 3. Four types of qualitative bar charts. 
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1787 1930 

0000000000 Electricity eooooooooo 

0000000000 3COOOOOOOO 

Work Animals 

& Water Power ; 03#« 000000 

0000000000 Tractors 0000999000 

0000000000 Trucks ooooooo^a# 

Each Disc Represents 10% of the Total Power 

(C). Types of power other than human labor power available on U. S. farms in 1930 
compared with 1787— a multiple unit bar chart. (Cohen, P., Technology Review, 
42,412,1940.) 

One Average American 
is responsible for the 
annual consumption of 

Textiles ^30 Pounds 


Paper 250 Pounds 



(Z)). TRe utilization of resources by an average individual — a pictorial bar chart. 
{Cohen, P., Technology Review, 43, 203, 1941.) 

Fig. 3. Four types of qualitative bar charts.— ConlmMed, 
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Since the qualitative graph is usually drawn for the layman, it should 
be particularly clear, simple, and attractive. There are various types 
which satisfy these requirements. Which to choose for a particular case 


At wt. 204 
1.5% 



(A). The stable isotopes of lead. {Com- 
mittee on Atoms, International Union 
of Chemistry, Rev. Sd. Instruments, 
7, 334-335, 1936.) 



{B). The composition of the earth’s 
crust- to the depth of 10 miles, in- 
cluding the lithosphere, the hydro- 
sphere, and the atmosphere. . {Clarke, 
F. W., Data of Geochemistry, 4th Ed., 
p. 35, U. S. Geol. Survey Bull. 695, 
Washington, D. C., 1920.) 


Charge Product 



(C). Relative weights of materials charged into and produced by a typical blast 
furnace. • 

Fig. 4. Three types of qualitative graphs for e3q)ressing percentages. 

depends somewhat upon the data, but often the choice is a matter of 
personal preference. Some common t3rpes of qualitative graphs are 
illustrated in Figs. 2 to 4. 
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5. The Quantitative Graph. A graph of the secpnd or quantitative class 
ordinarily shows the relation between two related variables in the form 
of a regular curve, which may or may not be expressed mathematically. 



The vast majority of graphs in this class are draym on ordinary rectan- 
gular coordinate paper with uniform scale divisions (Fig. 15). Other 
papers in rather common use are the logarithmic or log-log (Fig. 5), the 
semi-log (Fig. 6), the polar (Fig. 7), and the probability (Fig. 8). Their 
characteristics as to arrangement of axes and spacing of scales are readily 
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seen. When, the relation connects more than two variables, the nomo- 
gram (Fig. 9) is frequently a satisfactory form of graphical presentation. 



qoui ajenbs Jad spunoj spuesnom ur ssans 


' In certain cases trilinear paper (Fig. 10) can be used. These latter forms 
will not be discussed further. 

A graph, like any other tool, loses much in effectiveness when certain 
easily followed principles of construction are disregarded. There are 
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210 " 180 " 150 " 



330 “ 0 “ 30 “ 

Fig. 7. A polar graph showing the luminous intensity of an incandescent lamp as a 
^ .function of angle of view. 


seven main steps to the preparation of a satisfactory graph. They 
relate to 

(a) choosing the graph paper, 

(b) choosing the coordinate scales, 

(c) labeling the coordinate scales, 

(d) plotting the data, 

(e) fitting a curve to the plotted points,’ 

(/) preparing a descriptive caption, and 
(g) acknowledging the source of the data. 

(a) Choosing the Graph Paper, Important questions to consider here . 
are: 

1. Is ordinary rectangular paper or log-log paper or something else 
the most satisfactory for the particular case under consideration? 


09.0 09.8 09 98 00 00 80 70 CO 50 40 30 20 10 5 2 1 0.5 0.2 OJ 0.05 0.01 
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2. Is there the necessary preciseness of separation of the coordinate 
lines? 


3. Are the lines not so close to one another as to be confusing, yet 
sufficiently numerous as not to require excessive interpolation? 



4. Is the paper of such quality that it will stand erasures and pos- 
sible frequent handling? 

6. Is the paper of the needed transparency or opacity, on the one 
hand, to permit of tracing or blueprinting or, on the other hand, to 
prevent the print on pages below from showing through? 





REPRESENT AT' " ' ' 




alloys at 1830^F^^ showing metallographic phases present in Fe — Mn — O 
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6. If the graphs are to be reproduced in print, are the coordinate 
lines black so that they may show up well or blue so that they may 
not show at all? 

7. Are the sheets of such size as not, on the one hand, to lead to 
cramped scales, to the elimination of significant figures which the data 
may justify, and to errors due to the finite widths of the plotted 
points and the lines that may be drawn; or, on the other hand, to 
lead to such large scales as to indicate an accuracy greater than that 
which the data justify? Often the need for a large sheet may be satis- 
fied by pasting together two or more small sheets. Sometimes the 
margin of a single sheet may be used to extend the scales a sufficient 
amount. 

(b) Choosing the Coordinate Scales. A poor choice of scales for the 
coordinates, more than any other single factor, will make an otherwise 
acceptable graph unsatisfactory as a tool. Such being the case, the need 
of suitability rules is evident. Although none can be given to fit all 
cases, where the maximum revelation of content of data plotted or the 
maximum of ease and comfort in the use of the plot as a tool are con- 
cerned, certain general rules may be stated. Granted the best selection 
of graph paper, experience has shown it generally desirable to choose 
the coordinate scales in accord with the following rules. 

Rule 1. The scale for the independent variable should he measured 
along the so-called x-axis. 

This rule is a statement of an established custom. Which of two 
variables shall be viewed as independent is usually greatly influenced, 
if not actually determined, by either the experimental procedure or the 
nature of the resulting data. Where in a process of measurement involv- 
ing two or more variables, the values for one are fixed arbitrarily and 
corresponding values of the others are then determined, the former is 
generally regarded as the independent variable. At other times, which 
variable shall be so regarded is a matter of opinion. 

Rule 2. The scales should be so chosen that the coordinates of any 
point on the plot may be determined quickly and easily. 

No scale is acceptable if it is difficult to read. How much scales may 
differ in this respect is shown by XA) and (S) of Fig, 11, where extremes 
of readability are presented. Compare the two curves for ease and accu- 
racy with which refractive indexes corresponding to wavelengths of 
0.47iU, 0.65ji£, etc., can be located and read. 

For rectangular graph paper with the space between successive main 
lines divided into ten equal small spaces, the most convenient scales are 



42 


EEPRESENTATION OF DATA BY GRAPHS 


those in which such distances between successive main lines represent 
a difference in value of one, two, four, or five units, or these values 
multiplied by lO”" where n is an integer. Scales in which this distance 
represents three, six, seven, nine, or eleven units, etc., should seldom 
if ever be used. Other scales, corresponding to 1.25, 2.5, or eight units 
per main scale division may occasionally be found desirable. 



Fig. 11 . Refractive index of dense flint glass as a function of wavelength, on graphs 
with (A) convenient scales, {B) inconvenient scales. 

Rule 3. The scales should be numbered so that the resultant curve is 
as extensive as the sheet permits, provided the uncertainties of measure’- 
ment are not made thereby to correspond to more than one or two of the 
smallest divisions, ■ 

Coordinate scales need not, in fact generally do not, start from zero 
values. The scale for each variable may well begin, in accord with this 
rule, at or just below the lowest rounded value in the data and end at 
or just above the highest. There is, however, no justification for extend- 
ing a scale to such an extent th^t the uncertainties for the values plotted 
correspond to more than one or two of the finer scale divisions (Fig. 12). 

Rule If., Other things being equal, the variables should be manipulated 
to give a resultant curve which approaches as nearly as practicable to a 
straight line. 


THE QUANTITY IIVE GRAPH 


43 



Fig. 12. Showing over extension and under extension of a graph scale. In describing 
the performance of a generator, graph A exaggerates and graph B minimizes the 
accuracy. 



Fig. 13. Showing an advantage possessed by a differential graph. With pj repre- 
senting 1 atmosphere and vq 1 gmv/mole, curve A shows, for nitrogen at 0® C, 
vo/v as a function of p/po, and curve B shows pv/p(PQ as a function of p/po* The 
deviation from the ideal gas law is evident in curve B but not in curve A . {MicheU^ 
W outers, and de Boer, Physica (7), 1, 587, 1934.) 
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The straight line is the simplest curve to construct and to use. Where 
precision is a matter of concern, it is usually advantageous to plot, when 
possible, variables which cause the resultant curve to approximate a 
straight line. This is especially true when the graph is to be used for 
finding slopes or the constants of a rational equation by the methods to 
be described later. For example, if we wish to find the constants of an 
equation of state of the type 

pv = RT(l + ap + hp^ + cp^) [1] 

a graph of p as a function of v (Fig. 13A) is of little value. If, however, 
the product pv is plotted as a function of p (Fig. 135), the resultant 
curve will approximate a line whose deviation from the horizontal will 
show the first order deviation of the gas from an ideal gas, and whose 
deviation from straightness will show the second order variation from 
an ideal gas. 

Many other types of equation can be rectified. Thus, the equation 

= [ 2 ] 

gives the Wien approximation for the spectral brightness, B\, of a black 
body at temperature T in terms of the value o-^x for a black body at 
a standard temperature, To. If experimental values of In {B\) are plot- 
ted against l/T, the curve will approximate a straight line, since by 
taking natural logarithms of the original equation one obtains 

In(5x)-ln(oJ5x)=^(A_iy [3] 

an equation linear in In {By) and 1/T. The departure of such an ex- 
perimental curve from a straight line (for any one of many non-black 
sources) is a measure of the deviation 'of the spectral emissivity of the 
source from constancy. Similarly, data thought to satisfy the Stein- 
metz law for work done in a magnetization cycle 

W = aB^ [4] 

should give a straight line if log W is plotted as a function of log B. 
Many other equations may be handled similarly. (See Fig. 8.) 

Sometimes when the data fit a certain type of equation, a straight 
line graph can he obtained by plotting the measured variables on other 
than regular rectangular graph paper more simply than by manipulating 
the variables in some such manner as above. Thus, where the difference 
in temperature, 0, between a body arid its surroundings at any time, t, 
is given by Newton's law of cooling 


0 = 


[5] 



THE QUANTITATIVE GRAPH 


45 


a cooling curve approximating a straight line may be obtained by plot- 
ting log 0 as a function of i When semi-log paper is used, plotting 6 as 
a function of t suffices. This eliminates looking up and tabulating loga- 
rithms. This latter method, however, in view of suitability rules 3 above 
and 5 below, is often unsatisfactory, and especially so if the constants 
do and a are to be evaluated. 

Rule 5. Scales should be chosen such that the curve shall, to the extent 

possible, have a geometrical slope approximating unity. 

The geometrical slope of a curve at a point is the tangent of the angle 
between the x-axis and the tangent to the curve at that point, and is 
different from the physical slope of the curve dy/dx at the point in 
question, whose value contains the units of the quantities plotted. The 
latter quantity does not depend on the scales chosen for plotting, while 
the former depends completely on the scales chosen. 

Though rather generally ignored, the rule is of great value where pre- 
cision is concerned. This is especially true when a graph consisting of 
a straight line, obtained in accord with rule 4, is to be used as a tool. 

With scales chosen as suggested above, it is often found that a curve 
results whose geometrical slope does not vary much from unity at any 
point. This is quite desirable, for then deviations of the plotted points 
from the line wiU show up most markedly. Conversely, the line to be 
drawn may be drawn most precisely. An illustration is furnished in 
Fig. 14 by the work of Hecht ^ and others in their important study of 
'Tnergy at the Threshold of Vision.” Using Fig. 14H leads to greater 
certainty of correct assignments of quantum numbers than does using 
Fig. 14A. Doubters may weh trace the base lines and the computed 
curves for n = 6 quanta on translucent paper and attempt to fit the 
curves to the other sets of data. On the other hand, if one wishes to 
cover up departures of observed plotted points from a line to be drawn, 
he should choose the coordinate scales so that the geometrical slope of 
the line to be drawn shall be far from unity. The main objection to 
the use of log-log and semi-log papers, noted under rule 4, depends on 
these considerations. Usually the scales which they force lead to geo- 
metrical slopes differing widely from unity, and automatically many 
variations are covered up. 

There are many cases where the precision of one coordinate is so low 
with regard to the other that nothing is gained by following the unity 
slope rule and where m the interest of economy of space- one should 
deviate from the rule (see Fig. 12, also X-curve of Fig. 1, p. 243). 

1 Hecht, S., Staler, S., Pirenne, M. H., Science, 93, 585 (1941). 
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1.5 2.0 2.5 1.5 2.0 2.5 1.5 2.0 2.5 

Log of Average Number of Quanta per Flash 

a) 



(B) 

Fig. 14. Showing an advantage due to having an approximate geometrical slope of 
unity for the important portion of a line graph. The points graphed represent 
results obtained by . three observers at the threshold of vision, using light whose 
wavelength coincides with the maximum of the luminosity curve of the eye, and 
show the fractional part of the time that flashes were perceived as a function of 
the average number of quanta of light received per flash at the cornea. The lines 
represent the expected responses of the three observers in case just 5 {n 5), 
just 6, and just 7 quanta of the light used are required to produce just perceptible 
flashes. For the sake of separating the curves in graph B, 0.050 has been added to 
the observed log abscissa values for u = 6 and 0.350 for n = 7. That the expecta- 
tion curves are properly associated with the observed data is more evident when 
one makes use of graph B than when using graph A. (Hecht, S., ShaleVy S.y and 
Pirenne, M. H., Science^ 93, 585, 1941, and personal correspondence.) 
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(c) Labeling the Coordinate Scales, Scales are marked on graphs by 
labeling certain main coordinate lines with the values they represent. 
Not all main lines need be so marked. Often labeling every second main 
line results in the shortest time of location of a desired coordinate^ and 
yields in addition the best general appearance for the graph. Whatever 
the plan, it should be xmiform. One need not begin with the first line 
at the left or at the bottom of the graph unless the scale begins at zero, 
in which case the 0 should be recorded. It is suggested that the num- 
bers used in marking the scale contain as many significant figures as 
the data justify, or as are readable from the curve if, as is usually the 
case, the data are roughly equally accurate throughout. That is, 3.50 
may well be written instead of 3.5 when it is possible to distinguish 3.51 
from 3.50 in the data and on the plot. An essential part of a satisfactory 
scale designation is the inclusion along each axis of the name of the quan- 
tity represented and the units in which it is measured, e.g.. Temperature 
in °K, Pressure in atmospheres, etc. When the logarithm of a quantity 
is being plotted, the units in which the quantity itself is measured should 
be stated, e.g., log of Radiancy in watts/cm^, although strictly speaking 
it is impossible to take the logarithm of anything but a pure number. 

(d) Plotting the Data. Plotting the points to represent the data at 
hand is a simple process, but it should be done carefully if an accurate 
tool is desired. If the data to be plotted are experimental or computed 
and subject to computational errors, each point should be indicated by a 
suitable symbol, such as a cross (x) or a circle (O)* Different sets of 
data on the same graph should be denoted by different symbols if there 
is a possibihty of confusion otherwise. When computed data subject 
to negligible computational errors are plotted, the curve necessarily 
passes through all points plotted and nothing is gained by indicating 
plotted points. The point symbols should be omitted in such cases. 

(c) Fitting a Curve to the Plotted Points, Two types of cases are to be 
considered. In one, owing to the fewness of the observed points, the 
uncertainty as to the law of dependency of the assumed dependent vari- 
able on the assumed independent variable, or the possibility of unknovm 
variables entering, the plotted points are connected by straight lines. 
(Fig. 15.) ^ In the other type, sufficient points are assumed present to 
justify drawing a smooth continuous curve to represent the actual vari- 
ation of the related variables under consideration in the regions between 
the plotted points. For these cases the curves are generally so drawn. 
What is said here applies almost whoUy to this type. 

1 Hardy, J. D., and DuBois, E. F., Significance of the Average Temperature 
of the Skin,” p. 537 of report of symposium on Temperature — Tts Measurement and 
Control in Science and Industry^ New York, Reinhold Publishing Corporation, 1941. 
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Proficiency in judging the most likely course of a smooth curve 
through a set of plotted points requires practice. In the case of a 
single-valued function one may always include all plotted points on a 



Fig. 15. Illustrating the irregular broken line graph. Data, obtained with subjects 
in a calorimeter, show variations in the temperatures of various portions of the 
human body with different environmental temperatures. {Du Bois, B, F., Report 
on the Temperature of the Human Body in Health and Disease, in the symposium on 
Temperature, Its M.easurement and Control in Science and Industry, p. 2,4, New York, 
Reinhold Publishing Corp., 1941.) 

single smooth curve of many inflections. It is absurd, however, to think 
that such a curve will represent the true relation between y and for 
many curves can be drawn which will pass through the plotted points. 
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Usually a much better curve for representing the relation sought is 
obtained by following the principles listed below. 

1. The curve should be smooth, with few inflections. ® 

2. The curve should pass as close as reasonably possible to all of 
the plotted points. 

3. The curve need not pass through a single point, much less 
through either of the end points. Very often they are end points 
because of limits in the accuracy of the instrument or of the method 
used. In such cases less weight should be given to them than to the 
other points of the plot. 

4. The curve should usually, but not always, contain no inexplic- 
able discontinuities, cusps, or other peculiarities. 

5. When taken in moderate-sized groups, about one-half of the 
plotted points of each group should fall on one side of the curve and 
the other half on the other side. 

In addition to the pencil or the pen, transparent frames such as the 
ordinary so-called celluloid triangles, irregular curves, and ships curves 
are desirable for curve-drawing. In place of the last-named instrument, 
certain adjustable curves may often be conveniently employed. The 
transparency feature is of decided importance in connection with the 
application of the principles stated above. 

Granted the desired instruments, the procedure to follow in locating 
and drawing the best curve consists of (a) locating with the unaided 
eye, or, perhaps with the. aid of fixed transparent frames, certain points 
through which or close to which it seems that the curve should be 
drawn; (b) drawing lightly through the selected points, in pencil and in 
a preliminary way, one section of the curve and then successive adja- 
cent sections; and (c) drawing the desired curve in its final form, chang- 
ing where necessary the lightly drawn preliminary curve in accord with 
the principles stated above. 

In the drawing of both the preliminary and final curves, when a shift 
or a change of a frame is made, one should see that the frame in the 
adjacent shifted position permits of the smooth joining on of the new 
section without a sharp change of slope at the junction. The satis- 
factory carr 3 dng out of this procedure may be readily judged by the 
squint test. In making this test, the eye is held close to the plane of 
the graph sheet in such a manner that one can sight along the curve. 
If the adjoining sections have not been correctly matched, a sudden 
change in direction of the curve will be quite noticeable. Figs. 16A and 
16 jB represent the same data. As regarded ordinarily, both curves seem 
smooth and satisfactory. The squint test, however, reveals that one 
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Fig. 16 . Showing two graphs which differ in that, as revealed by the squint test, 
the curve of A shows a kink while the curve of B does not. When slopes of curves 
are determined graphically such kinks are dangerous and may lead to erroneous 
conclusions. See discussion relating to Fig. 2 of Chapter XL The data plotted 
show the emf of Rh vs. Pt as a function of the temperature of the hot junction. 
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of the curves fails to pass the test. Where the curve is to be differ- 
entiated graphically, the need for its application is great; As will appear 
in Chapter XI, a suspected kink in a graph of the data of Fig, 16 was 
the source of a difference of opinion that was later settled by least- 
squares treatment. 



Fig. 17. A combined graph, as presented by Hecht, showing for various individuals 
the brightness discrimination factor aB/B as a function of the logarithm of the 
brightness B. 

Kinks in curves are not always to be avoided. Their presence may 
reveal important processes or changes of process. An interesting case is 
furnished by the work of Hecht.^ It concerns the explanation of the 
observed variations in brightness discrimination, AB/B, where AB rep- 
resents the least perceptible change in the brightness B, as a function of 
that brightness. Results of previous reliable work relating to what is 
commonly referred to as the Weber-Fechner law was combined in a single 

1 Hecht, Selig, Proc. Natl Acad, Sci. U. S., 20, 644 (1934); /. Psychol (6) 33, 161 
(1936). 
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graph. (Fig. 17). Except perhaps for the results of Aubert, there seems 
no indication of a kink or break in the curve. By the proper choice of 
scales and with the aid of an assumed explanatory law, Hecht, however, 
found significant breaks in the data for each observer and made them 
obvious. We here consider the observations reported by Blanchard.' 
His data, disregarding for lack of space the value for the lowest bright- 
ness, are replotted in Fig. 18 on the same basis as for Fig. 17, but with 
scales so chosen that the presence of a kink or break might well show up. 
Except for the single value of AB/B corresponding to —3.17 for log B, 
there seems to be no indication of a break. Most workers in this field 
passed over it as just another rather unsatisfactorily determined point. 
Hecht, however, believing that the two types of visual processes corre- 
sponding respectively to the cone and the rod receptors of the retina 
might well follow different laws, sought for indications in such brightness- 
discrimination curves. With log AB/B rather than AB/B graphed as 
a function of logS (Fig. 19), the evidence became unmistakable. Not 
only that, but there were verified the two theoretical equations, 



which with properly chosen values for c and K holds for the rod or 
brightness region, and 


AB 

B 


1 + 


_4^Y 

Vkb/ 


[ 6 ] 

low- 

m 


wMch similarly holds for the cone or high-brightness region. The kink, 
which with the proper function graphed became a break, is highly im- 
portant here. Without doubt other similar breaks are waiting for 
discoverers. 

When the curve to be drawn is known or judged to be a straight line, 
its course may be located by moving about among the points a stretched 
black thread, the straight edge of a transparent frame or, best of all, a 
straight line scratch on the under surface of a transparent frame. In 
any case the final line should be drawn with the aid of a straight edge. 

If a curve is to be used for the exact determination of corresponding 
values of y and rr, or if it is to be used for obtaining highly precise deriva- 
tives, it is necessary to make the curve as fine a line as is practicable. 

Some authors, in drawing curves among plotted points, draw them in 
segments, with a break occurring wherever the curve if continued would 
cut through a point symbol. The questionable argument in its favor seems 

^ Blanchard, Julian, PA 2 /S. to., 11, 81 (1918). 
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Log B in Millilamberts 

Fig. 18. A graph similar to Fig. 17, but with much more favorable scales for showing 
kinks or breaks, in which only data by Blanchard are regraphed. (Blanchardj 
JuUaUy The Brightness Sensibility of the Retina, Phys. Rev., 11, 81, 1918.) 



-5 -4 -3 -2 -1 

Log B in Millilamberts 


Fig. 19. Showing, as presented by Hecht, the data of Fig. 18 replotted with log 
(AB/J5) rather than AB/B as a fimction of log B. The open circles represent data 
obtained by Blanchard in 1918, the full circles added data obtained by Lowry in 
the same laboratory in 1931. The full line curves represent the predictions of 
Eqs. 6 and 7. 
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to be one of artistic appearance. For the qualitative graph, that suf- 
fices. For the quantitative graph, however, it seems wise to continue 
the curve as a line regardless of the point symbols intersected. Where 
the squint test is of value, the curve must continue thus uninterrupted. 

(/) Preparing a Descriptive Caption. The caption accompanying a 
graph when completed should include an accurate description of what 
the graph is intended to show. How complete this should be is some- 
what a matter of opinion. If the graph is to be a part of a publishable 
report, it should be remembered (1) that graphs and tables are often 
the portions of an article which excite the interest of a possible reader; 
(2) that time is saved in the reading of an article if suitable descriptive 
captions are found adjacent to the figures; (3) that certain material 
incorporated in a caption may appropriately be left out of the body of 
the text; and (4) that in referring tq^^a paper some time after a reading, 
a reader hopes to find certain quantitative data that it contains in its 
figures and tables, and that a search in the body of the paper for that 
which may appropriately be placed in a caption is likely to be a source 
of irritation. On the other hand, one can hardly include the whole of 
the text in figure and table captions. 

{g) Acknowledging the Source of the Data. Wherever the data for a 
graph are taken from a published report or the work of another, the 
source should be plainly stated in the caption. An exception occurs 
where the data have been widely published, e.g., the Maxwellian distri- 
bution of molecular speeds for a gas. Wherever a graph by itself is pre- 
sented as a report, it should carry the name of the author and an appro- 
priate date. 

6. Stumnary. As devices for presenting data, graphs have many 
advantages over other forms of presentation. Two classes of graphs are 
considered: the qualitative, including those intended for a convenient 
and picturesque way of presenting data, and the quantitative, including 
those intended for use as tools, either in research or in operating or con- 
trolling mechanisms or processes. 

There are many types of qualitative graphs which possess the attri- 
butes of clarity, simplicity, and attractiveness desirable in graphs of 
this class. Regardless of type, each such graph should contain an 
appropriate and complete descriptive caption. 

Though the quantitative graph usually takes the form of a 3:egular 
curve, there are many different types in this class since the curve may 
often be plotted on any one of about six different general types of papers. 
The quantitative graph should be carefully drawn and certain general 
principles of good construction should be followed. These principles are 
listed and discussed in detail for each of seven main steps in the prepara- 
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tion of a satisfactory graph: (1) choosing the graph paper, (2) choosing 
the coordinate scales, (3) labeling coordinate scales, (4) plotting the 
data, (5) fitting a curve to the plotted points, (6) preparing a descriptive 
caption, and (7) acknowledging the source of the data. 


PROBLEMS 

1. Following the instructions given in the text, and using the data given below 
showing the radiancy of tungsten ^ as a function of temperature, plot curves showing 
(R = f{T) on ordinary rectangular graph paper, (R = /(P) on log-log paper, and 


log (R = /(log T) on 

ordinary rectangular paper. 



T 

(R 

T 

(R 

1600° K 

7.74 watts/cm^ 

2400° K 

55.70 watts/cm^ 

1800 

14.15 

2600 

80.6 

2000 

23.65 

2800 

112.5 

2200 

37.20 

3000 

154.5 


2. Using the following data^ showing the brightness of incandescent tungsten as a 
function of temperature, plot with care four curves on one or more two-page sized or 
larger sheets of rectangular graph paper. Use ships or other equivalent curves and 
apply the squint test. For the first graph plot B = f{T); for the others plot 
log B = /(log T)j but choose the coordinate scales to yield approximate geometrical 
slopes of 1.0, 0.5, and 0.25. Keep this plot for use in a graphical differentiation 
problem in Chapter IV. 


T 

B 

T 

B 

2000° K 

20.0 c/cm^ 

2600° K 

345 c/cm2 

2100 

35.9 

2700 

495 

2200 

61.0 

2800 

690 

2300 

100.1 

2900 

950 

2400 

156.0 

3000 

1270 

2500 

234.0 




1 Forsytbe, W. E., and Watson, E. M., J. Optical Soc, Am. 24, 114 (1934). 
^ Idem. 
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REPRESENTATION OF DATA BY EQUATIONS 

1. Introduction. It is often desirable to express in equation form the 
relationships between variables which may be suggested by graphs or 
tables. On the one hand such a derived equation or one or more of its 
coefficients may represent the objective of a research. On the other 
hand, it may be desired as an aid to differentiation, integration, or inter- 
polation. Moreover, an equation is a compact, easily remembered, and 
convenient form for the presentation of data. Methods for obtaining 
such equations will be discussed here. However, only forms involving 
one dependent variable will be treated. Periodic curves will be taken 
up in Chapter V; distribution functions for statistical data in Chapter 
VII. 

2. Rational and Empirical Equations. An equation for representing 
experimental data is said to be rational if it is derivable theoretically. 
For example, the equation 

. d r.-, 

g = a sm - [1] 

relating the throw, d, of a ballistic galvanometer to the electric charge, 
q, causing the throw, is rational, since it is based on established physical 
laws. In this case the finding of an equation reduces to the finding of a 
value for the constant, a. 

An equation for representing experimental data is said to be empirical 
if its form has not been derived theoretically. In the process of obtain- 
ing such an equation, one must first find a suitable form. Given that 
form, the further procedure becomes the same as that for the rational 
equation. 

3. Choosing a Suitable Form for an Empirical Equation. The ideal 
empirical equation is one that represents the experimental data closely, 
yet has only a few arbitrary constants — ^two generally opposing charac- 
teristics. As a consequence a choice must sometimes be made involving 
a sacrifice either of simplicity or of precision of fit. On the other hand, 
a choice must sometimes be made from two or more functions which, 
in a given case, approach the ideal form about equally. There is no 
straightforward method of obtaining a most suitable function for a given 
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set of data. Usually one simply plots the data, represents them approxi- 
mately by means of a curve, and, guided by experience and a knowledge 
of analytic .geometry, makes a guess as to the form of the equation. If, 
on being tested, this form is found unsatisfactory, a new guess is made 
and tested. This process is repeated until one is satisfied. With the 
ease and precision of such testing in mind, it is usually advisable, whei'e 
possible, to select coordinates which yield as nearly a straight line as 
possible. 

The selection of such coordinates and the drawing of a best curve 
whose equation is sought brings up the question of the changed relia- 
bilities (more precisely weights) assigned, in effect, to the various plotted 
points, which accompany changes of coordinates. The significance of 
weights, how coordinate changes affect them, and the account that 
should be taken of changed weights will be discussed in Chapters IX 

to xr. 

To assist the less experienced, the curves of Figs. 1 to 6 are presented as 
examples of the shapes of curves which may be obtained from several of 
the more common types of equations by varying the arbitrary constants. 

4. Testing the Suitability of aii Empirical Function to Represent a 
Set of Data. Fortunately, one need not evaluate the constants for a 
particular form of equation to see whether or not that form fits the data 
satisfactorily. Certain preliminary tests often not only give the infor- 
mation desired, but help later on when the constants are to be calculated. 
For simple types of equations with only one or two arbitrary constants, 
the following graphical test is convenient. For more complex forms, a 
tabular test may be used. 

(a) The Graphical Suitability Test The procedure here consists . of 
three steps. ^ 

1. Write the assumed relation, f(x,y,a,b) = 0, in a form that is 
linear with respect to two selected functions, Fi and F 2 , which do not 
include the arbitrary constants, a or &, thus 

= A + BF 2 [2] 

Of these two functions, often one may involve x only while the other 
involves y only, and the new constants A and B will be functions of 
a and b only. 

2. Calculate Fi and F 2 for a few, four say, widely separated pairs 
of values for x and y. 

3. Plot Fi as a function of F 2 . Insofar as a straight line is obtained, 
the assumed equation would seem to be satisfactory. Greater cer- 
tainty is obtained by taking into account the remaining pairs of Fi 
and F 2 . 
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To illustrate, we shall use the method to determine whether or not 
the data of Table I may be represented by an equation of the form 

y = [3] 

TABLE I 
\ 

Data for Illustrating a Graphical Test for the Suitability op an Empirical 

Function 


X 

1 

i 

2 

i 

3 

■4 

5 

6 

7 

8 

9 

y 

T.78 

2.24 

2.74 

3.74 

4.45 

5.31 

6.92 

8.85 

i 10.97 

log y 

0.250 

0.350 

0.438 

0.573 

0.648 

0.725 

0.840 

0.947 

: 1.040 

Vc 

1.76 

2.21 

2.78 

3.51 

4.39 

5.52 

1 6.93 

8.71 

10.94 


Eq. 3 written in a form similar to Eq. 2 becomes 

log y = log a + (5 log e)x [3a] 

in which log y corresponds to Fi, x to F 2 , log a to A, and (b log e) to B. 
Plotting log y for four selected points, marked by o in Fig. 7, as a func- 
tion of X, a straight line results. The choice of Eq. 3 seems satisfactory 



Fig. 7. A plot for testing whether Eq. 3 fits the data of Table I. 

for representing the given data. This conclusion is verified by the fur- 
ther plotting of points and finally by comparing the observed ^/-values 
with the computed values (shown as yc in Table I) eventually obtained. 



60 REPRESENTATION OF DATA BY EQUATIONS 

Methods for determining the constants of the equation Uc = f{x) are 
given below. 

Certain two-constant equations, such as t/ = a(l — y ~ x°' -\- hx, 
etc., which cannot be written in the form of Eq. 2 cannot be tested by 
this method. Among those which can, however, be so tested are 


y = ax [4] 

y = a + hx [5] 

y = a¥ , [6] 

y = ■ [7] 

y = ax^ [ 8 ] 

y = etc. [10] 


(b) The Tabular Suitability Test. When more than two arbitrary con- 
stants are involved, a tabular method is convenient for testing an as- 
sumed equation form. The procedure depends on the equation assumed, 
but in general it consists of (a) making a plot of the experimental data, 
(b) constructing a table from the graph, (c) forming certain successive 
differences, and (d) examining the final set of differences for approximate 
constancy, the criterion of suitability for the assumed equation. 

For data already in a suitable tabular form, steps a and h are unneces- 
sary. Procedures and criteria for testing several of the more common 
types of equations are given in Table II. 

Just what successive differences are to be obtained is not difficult to 
determine. Consider case 1 of the table. If 

y = a + bx + cx^ + dx^ [11] 

then also 

y + Ay = a.+ b(x + Ax) -f c(x + bx)^ -j- d{x -t- Ax)^ [12] 

and 

I ' 

Ay = (bAx + cAx? -f- dAx^ ) -f- { 2 cAx + SdAa:^ -| )x 

(^dAx ■ ■)x^ [ 23 J 

Since Ax is to be kept constant during the test, Eq. 13 takes the form 
Ay = a' -j- b'x -f c'x^ 
of which a'y V, and c' are constant. 


[ 14 ] 
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Eepetition of the above procedure leads similarly to 


and finally to 


= a" + V'x 


A^y = a'" 


[15] 

[16] 


This last equation shows that, if Eq. 11 holds and Ax is maintained con- 
stant throughout, the third-order tabular differences will be constant. 
Conversely, if such third-order tabular differences are found constant 
except for uncertainties of measurement, etc., the data may be repre- 
sented by Eq. 11. 

TABUE III 


Tabular Test por the Suitability op an Equation op the Form y = a + 6 c® 
TO Represent Certain Observed Data 


Observed Values 

Taken from Graph 

Computations of 

Successive Differences 

X 

y 

X 

y 

A?/ 

log (A^) 

A log {Ay) 

0.50 

17.3 

0 

16.6 








1.3 

0.114 


1.75 

19.0 

1 

17.9 



0.090 





1.6 

.204 


2.76 

21.0 

2 

19.5 



.097 





2.0 

.301 


3.60 

22.5 

3 

21.5 



.079 





2.4 

.380 


4.50 

25.1 

4 

23.9 



.097 





3.0 

.477 


5:25 

28.0 

5 

26.9 



.091 





3.7 

.568 


6.00 

30.5 

6 

30.6 



.085 





4.5 

.653 


6.50 

33.0 

7 

35.1 



.103 





5.7 

.766 


7.50 

38.0 

8 

40.8 





As inspection will show, the underlying theory for the other cases of 
the table is much the same. Consider case 7. The equations corre- 
sponding to Eqs. 11 to 16 are 


y = a + ie‘'^ 

y “h Ay = a = a -)- 


[17] 

[18] 
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Aj/ = [19] 

In Ay = ln[6(e®'**— 1)] + c'x = V + dx [20] 

A(ln Ay) = c'Aa: = V [21] 

Many other functions may be handled similarly. In the case of still 
other functions, there seems no possibility of such treatment as a cri- 
terion of suitabiUty of equation form, e.g., 

y = ae-^^ -f [22] 



Fig. 8. A plot constructed to test the suitability of Eq. 23 to represent the data in 
the first two columns of Table III. 


To illustrate the use of Table II, we shall test whether or not an 
equation of the form 

y = a + hd" [23] 

can suitably represent the data in the first two columns of Table III. 
We first plot as a function of x (Fig. 8). Then, using the curve, we 
list values of y corresponding to equally spaced values of x (Table III). 
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Next we obtain, in turn, the successive differences, A^/, log (A^/), and 
A log (Ay). The values of A log (Ay) are essentially constant, indicating 
for Eq. 11 a certain suitability of choice. 

5, Evaluating the Arbitrary Constants. Once a satisfactory form of 
equation has been chosen, or, in the rational case, derived, the problem 
has been reduced to finding suitable values for the constants. Numer- 
ous procedures, varying in ease and in accuracy, are available. The 
most accurate is the method of least squares, discussed in detail in Chap- 
ter XI. Since it ordinarily involves much computation, other methods, 
less accurate but also less cumbersome, are very much used. Frequently 
one of these methods is used to give an approximate result which may 
be later improved by the successive approximation method or, in cases 
where the labor is justified, by the method of least squares. If it is 
known in advance in any case that either the successive approximation 
or the least-squares method is to be used finally, considerable time may 
often be saved by definitely dealing at first with only rounded con- 
venient values for the desired constants. 

(a) Straight-Line Graph Method— Equations with Two Arbitrary Con- 
stants. For the simple equation with one or two arbitrary constants, 
the constants can be evaluated by a continuation of the graphical test 
for suitability outlined above. The method is best explained by an 
illustration. If was shown that the data of Table I may be represented 
by 2/ = ae^"" because log y plotted against x gave a straight line. The 
slope of this line is (b log e). The intercept on the (log 2 /)-axis is log a. 
From Fig. 7, the slope is found to be 0.0991, and the intercept, 0.147, 
whence 


and 


0.0991 
log e 


0.0991 

0.4343 


0.228 


a = 10^*^^^ == 1.403 
The final form of Eq. 3 is, then, 


[24] 

[25] 


2/ = 1.4036^*2^®^ [26] 

Values of y calculated with the aid of this empirical equation (listed in 
Table I as 2/c) agree well with the listed values for y. 

In obtaining the slope of the line, the familiar two-point formula 


I ^ 

X2 — Xi 


[27] 


may be used. Here (xi,yi) and ( 072 , 2 / 2 ) may be any two points on the 
line, but for greatest accuracy they should be as far apart as practicable. 
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For convenience they may be taken as the intersections of the curve 
with two main rc-coordinate lines, so that (x 2 — xi) shall be a convenient 
divisor. Similarly, the intercept, a, when it cannot be read directly 
from the plot, can be calculated by the two-point formula 

a = [28] 

X2 — Xi 


The advantages of using the same two points in evaluating a and b are 
obvious. Those familiar with the general determinant method of find- 
ing equations will conveniently substitute the given values for x and y 
in the determinant equation 


y X 
2/1 



[29] 


12/2 X2 1 I 

and simplify. 

The extension of the above method to Eqs. 4 to 10 listed above should 
be evident. 

(5) The Straight-Line Graph Method — Equations with Three Arbitrary 
Constants. To evaluate the constants of a three-constant equation by 
the straight-line graph method, one must first eliminate one of the con- 
stants and then treat the resultant two-constant equation as described 
above. The scheme to be used in eliminating a constant depends on the 
type of equation being fitted. Methods follow for three of the most com- 
mon types of equations 

y — a + bx + cx^ [30] 


y — a + bx"^ [31] 

and 

y = a A' bc^ [32] 

For straight-line methods of treating other three-constant and many 
four-constant equations, the reader is referred to more complete sources.^ 

(1) y = a + bx + cx^ 

The equation is that of a parabola, of which a is the y-intercept. If 
data are given close to x == 0, or if the y = f(x) curve may be safely 
extrapolated to the y-axis, a may be determined directly. It is then a 

^Running, T. R.j Empirical Formulas f New York, John Wiley & Sons, 1917. 
Lipka, J., Graphical and Mechanical Computaiion, New York, John Wiley Sons, 
1918. 
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simple matter to treat (y - a) as a new variable, y' say, and to evaluate 
6 and c, as shown above, using the form 

y^ = h + cx [33] 

X 

When a cannot be thus evaluated, we may possibly shift the origin of 
the coordinate system to some convenient point (a;o, j/o) in the neighbor- 
hood of the actual plotted pointe, through which it has been decided that 
the curve shall pass. The coordinates {x', y') of the observed points in 


the new system are given in magnitude by (x — Xo,y — yo)- Since the 
curve now passes through the origin it takes the form 

y' = b'x' + c'x'^ . [34] 

which may be rewritten as 

^, = b' + c'x' [35] 

X 

Values for 6' and c' are found from a plot of 2/' A' = /(^O* Then c, 6, 
and a are given by 

c = c' [36] 

& = 5' - 2c% [37] 

and 

a ^ yo — h'xo + c'xo^ [38] 


The method will not be illustrated, since it is generally less acceptable 
for parabolic equations than the selected-points method, combined, if 
necessary, with the successive-approximation method. 

( 2 ) 2 / = + 'bx^ 

Here the constant a represents the y-intercept of the curve if c is posi- 
tive, or of an asymptote parallel to the x-axis if c is negative. It may 
sometimes be obtained directly from the y — J{x) curve. Usually a 
satisfactory value cannot be so obtained, and we must evaluate or 
eliminate it by some alternate method. Probably the simplest suitable 
method of evaluation proceeds as follows. 

Select from the experimental curve, three widely separated points, 
(xi,yi), (X 2 ,y 2 ), and (xz.yz) such that 

X3 = (xi'X2)^ [39] 

Then 

bxs^ (bxi^’bx2^y^ 
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or, since for every point on the curve, = y — a 
yz - a = V {yi — a) ( 2/2 - a) 

whence 

[40] 

2/1 + ^2 2^/3 

We may then treat (y — a) as a new variable, y[, and write Eq. 31 as 

y' = hx^ [41] 

for which 5 and c can be evaluated by the straight-line graph method 
for two constants. If the plot log y' = /(log x) is concave downward, 
the computed a is too small, and vice versa. Corrections for such errors 
may be obtained by the method of repeated trials. 

{Z) y a + 1 ) 0 ^ 

When this type of equation fits the data, the value of a cannot be 
read directly from the curve of y = S{x), It can, however, be calculated 
as follows. 

Choose three widely separated points on the curve such that 

Xs = h{xi+X2) [42] 

Then 

(logc)a ;3 = •|[(logc)xi + (logc)a; 2 ] [43] 

or, since for any point on the curve, 

(logc)a: = log^^-^ [44] 

0 



, (2/3 - a ) 1 fi (2/1 “ a) , , (2/2 - a ) 

log ^ =l pog ^ + log ^ J 




[45] 

Hence 

and 

yz - a = ^(yi - a){y 2 - a) 

[46] 


^ 2 / 12/2 - yz^ 

yi + Vs - 22/3 

[47] 

As before, 

we may then set {y — a) = y', whereupon 



y' = ]xf 

[48] 

for which 6 and c may be evaluated by the straight-line graph method 


for two constants given above. If in the plot of log y' = f(x), the line 
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is slightly concave downward, the computed a is too large, and vice 
versa. As before, corrections for such errors may be obtained by the 
method of repeated trials. 

(c) Method of Selected Points, The procedure of this method consists 
of four steps. 

1. Plot 2 / as a function of x and fit a smooth curve as carefully as 
is needed. 

2. From the curve choose a number of points equal to n, the num- 
ber of arbitrary constants in the equation selected to represent the 
data. For convenience these points should lie on main rr-coordinate 
lines; for accuracy they should be widely separated without lying at 
the relatively uncertain extremes of the curve. 

3. Substitute in turn each of these pairs of x- and 2/-values into 
the chosen equation, thus obtaining a set of n equations with n un- 
knowns. 

4. Solve these n equations simultaneously for the unknowns, i.e., 
for the desired arbitrary constants. 

When the chosen equation is transcendental with three or more arbi- 
trary constants, step 4 may prove to be very difficult. When, however, 
the equation is, or can be made, linear with respect to its arbitrary con- 
stants, the procedure may be simplified by the use of determinants. 
Steps 3 and 4 then combine to a single step. 

Illustrating the simplified procedure, consider the curve of Fig. 9, for 
which an equation linear with respect to its arbitrary constants, of the 
type. 

y a + hx + cx^ [49] 

is desired. The first step of plotting has been carried through. As the 
second step, we select the points where the curve crosses convenient 
a:-coordinate lines at 4, 8, and 12. The corresponding 2 /-coordinates are 
8.1, 12.8, and 16.0. As the third and fourth steps combined, we write 
the determinant equation 


y 

1 

X 



8.1 

1 

4 

16 

0 

[60] 

12.8 

1 

8 

64 

16.0 

1 

12 

144 



Simplified, this determinant yields 

y = 1.90 ■+* l,73Sx - 0M69x^ 


[ 51 ] 
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as the equation sought. Equations thus derived should always be tested 
for errors and for goodness of fit. Substitutions, accordingly, of 4, 8, 
and 12 for x show that no computational error has been made in obtain- 
ing Eq. 51. However, tests for a; = 2 and a; = 16 yield values for y 
that do not check with the curve as drawn. Two possible conclusions 
may be drawn. (1) It is dangerous to extrapolate beyond observed 
regions. (2) Perhaps the desired form of equation is not capable of 
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Fig. 9. A parabolic curve whose constants may be evaluated by the selected points 

method- 

satisfactorily representing the data, and one should try another form. 
Reference to Figs. 1 to 6 reveals a similar curve in curve A of Fig. 6 and 
suggests that an equation of the form 

y — ahxx 

might satisfy. Actually, however, additional terms, similar to those of 
Eq. 51, are needed for a satisfactory representation. 

Essentially the same procedure may often be used for less obvious 
cases where linearity with respect to the arbitrary constants themselves 
does not exist, but where linearity with respect to certain functions of 
those constants does exist. Where the desired equation is of the form 


^ = a sin {(d + (^) 


[52] 
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with y and (d as variables and a and as the unknown constants, a 
change of form yields 

y = acos(l> sin cot + a sin <l) cos cot [53] 


of which a cos (jo and a sin ^ are now the unknown constants in linear 
form. As such they may be obtained easily by using the above method. 
To obtain separate values for a and ^ thereafter, we make use of the 
two obvious relations 


and 


a = (a^ cos^ <^> + sin^ cjo) 


H 


<f> = tan 


a sin (jo 
a cos cjo 


[54] 


[55] 


Where the desired equation is, for example, of the type 

= [56] 

linearity with respect to arbitrary constants may be obtained by chang- 
ing the form of the equation to 

\ny = \tL a -\-hx + ca^ [57] 

Obviously, determining In a is equivalent to determining a. For equa- 
tions like Eq. 56 which are made linear by writing them in linear form, 
it will usually prove advantageous in step 1, to plot In «/ as a function 
of X rather than to plot one variable as a function of the other. 

As a second example illustrating this very important method, let us 
fit Eq. 56 to the data of Table IV by the method of selected points. 
An examination of the range of 2 /-values in Table IV shows the im- 
practicability of trying to draw a curve of y = /(x) from which to choose 
the points with sufficient accuracy. Hence, we follow the suggestion of 
the previous paragraph and write the equation in the linear form of 
Eq. 57, or, even better for computational purposes, in the form 

log y = log a -f (0.43436)x + (0.4343c)a;^ 

= a' + b'x -f c'x^ [58] 


We then tabulate values of log y and plot them as a function of x, Fig. 
10. Remembering the convenience and accuracy suggestions of step 2 
above, we select the three points (0.250,0.356), (0.550,1.031), and 
(0.850,2.158). If, further, we make the simplifying substitutions 


, X — 0.550 
* 0.300 


[59] 


and 


z = log 2 / — 1.031 


[60] 
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we obtain a simple expression capable of easy evaluation, namely 

z la:' a:'^ 

-0.675 1 -1 1 

= 0 [61] 

0 1 0 0 
+1.127 1 11 



Fig. 10. A plot showing log y ~ /(a?), Table IV, for obtaining an equation by the 

selected points method. 


To one familiar with determinants, inspection yields the solution 


/1.127 + 0.675 \ , , /1.127 -- 0.675\ 

-V i 5 ) 


J2 


= 0.901x' + 0.226:r^ 


/2 


[62] 
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Substituting for z and x' in accord with Eqs. 59 and 60, we obtain 

log 2 / = 0.1388 + 0.2411a: + 2.5111a;^ [63] 

and 0 

y = [64] 

TABLE IV 

Data fok Illustrating the Selected Points Method of Finding an Empieicajl 

Equation 


[The prime of 2/'c is intended to indicate that these computed values are first approximations only] 


X 

y 

log y 

y'c 

log y'c 

log y - log y'^ 

0.125 

1.595 

0.2028 

1.615 

0.2082 

-0.0054 

.250 

2.239 

0.3500 

2.269 

0.3559 

1 - .0059 

.325 

2.995 

0.4764 

3.037 

0.4824 

- .0060 

.460 

5.626 

0:7502 

5.698 

0.7557 

- .0055 

' .575 

12,97 

1.1069 

12.81 

1.1076 

- .0007 

.675 

27.92 

1.4459 

27.90 

1.4455 

+ .0004 

.750 

53.88 

1.7314 

63.95 

1.7320 

- .0006 

.850 

141.7 

2.1514 

143.8 

2.1579 

- ,0065 

.925 

320.8 

2.6062 

323.8 

2.5103 

- .0041 

.975 

571.3 

2.7569 

576.7 

2.7610 

- .0041 


Values of y and logy calculated by Eq. 64 are given in Table IV in 
the columns headed y'c and log y'c- Inspection shows that the com- 
puted log y'c values are uniformly too great. A value of log a less by 
0.0038, yielding 1.365 for a itself gives a much better check between y 
and y'c- However, even with the suggested change, it is evident that the 
fit is not as satisfactory as it might be. With the —0.0038 change as- 
sumed made, values of log y — log y'c are uniformly too great for low 
and for high values of x and too small for intermediate values. The 
further application of the successive approximation method, as shown 
later, 37ields corrections which eliminate this tendency. 

For equations with more than two arbitrary constants, the method 
of selected points is recommended whenever applicable, for it is gener- 
ally simpler to carry through than the straight-line graph method, and 
more accurate than the method of averages to be described. 

*(d) Method of Averages. This method is a seZeci^cd-pom^s method based 
on a particular method of selecting points, which can be used only when 
the type of equation dealt with is linear with respect to its arbitrary 
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constants; i.e., when the equation may be written in the form of Eq. 
49. It is also known as Norman Campbell^s zero-sum method/ so called 
because, for the straight line, it yields zero as the sum of all the devia- 
tions. For this case with points randomly and similarly distributed 
mth respect to the straight line to be drawn, this method 5delds results 
comparable with those obtained by the least-squares method (Chapter 
XI). 

The procedure for the equation, y = fix), containing n arbitrary con- 
stants consists in (1) dividing the N observed pairs of x, y values into 
n approximately equal groups, choosing for each group only pairs that 
correspond to adjacent points when graphed; (2) averaging the x- and 
the ^/-values for each group separately to obtain n pairs of x, y values; 
(3) with these average x, y values to describe selected points, using the 
selected-point method as described above. 

The results depend somewhat on the way the original N pairs of 
values are grouped and accordingly cannot be expected to yield the 
most precise results in the general case. This method does not require 
a graph and generally speaking is much shorter than most other methods. 
However, when one departs from the straight-line equation, for which 
it is particularly acceptable, it still serves well in giving a first approxi- 
mation which may be improved by further approximations. 

Let us apply the method to data (Table V), given by Osborne and 
Meyers 2 of the Bureau of Standards in an attempt to obtain an equa- 
tion for use in determining the boiling point of water as a function of 
barometric pressure. For this purpose only data in the neighborhood 
of the normal, boiling point is needed. The successive-difference test 
shows that a three term equation of the type 


T = Tq + a(po - p) + &(po' - vf [65J 


in which the subscript (0) refers to standard conditions, namely, 100^ C 
and 760 mm-Hg, should suffice. Certain data as selected are shown 
grouped in columns two and three. The averages are shown in the 
ne:k:t two columns. For carrying the work further, it is desirable to 
introduce new variables 


p 720 mm-Hg 
60 mm-Hg 


[ 66 ] 


T - 98.486°C 
1.000 C° 


[67] 


1 PM. ikTof;., VI, 39, 177 (1920). 

^ Osborne, N. S., and Meyers, C. H., J. Research N Bur. BtaridardstlZ,! (1934). 
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TABLE V 

Data Showing the Boiling Points op Puee Wateb pok Vaeious Pebssukes in 

THE NeIGHBOBHOOD OP NOEMAL AtMOSPHEEIC PRESSURE GiVBN BY OsBORNE AND 

MeyerA for Use in Illustrating the Method op Averages foe Determining 

Equations 


Group No. 

p in mm-Hg 

T in "C 

Group p in mm~PIg 

Average T in °C 


800 

101.443 



1 

780 

100.729 

780 

100.724 


760 

100.000 




740 ' 

99.255 



2 

720 

98.492 

720 

98.486 


700 

97.712 




680 

96.914 



3 

660 

96.095 

; 660 

96.088 


640 

95.256 




In determinant form, the equation using x and y becomes 



y -x 




2;238 1 

1 = 0 

[68] 


-2.398 -1 

1 


which simplifies to ’ 

and to 

y — 2.318a: — 

O.OSOa:^ 

[69] 


T 3.486® C — 0.03863 — 720 mm-PIg) 

mm~Hg 

- 0.0000222 — (p - 720 [70] 

On transferring to standard conditions this becomes 

T = 99.995° C - 0.03686 (760 mm-Hg - p) 

mm-Hg ® 

0.0000222 mm-Hg — p)^ [71] 


^ Idem. 
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Though, the fit of this equation is not bad, it is quite inferior to that of 
the followiag equation determined by the selected points method. 

T = 100.000° C - 0.03682 - (760 mm-Hg - p) 

mm-Hg 

- 0.0000219 - ^ (760 mm-Hg - [72] 


(e) Method of Moments, This method is sometimes used when the 
equation sought is of the form 

y == fipc) = a + hx + cx^ h [73] 

The procedure requires that the :c-coordinates of the points to which the 
equation is to be fitted differ by a constant, Ax. If the original data do 
not satisfy this condition, it is necessary to plot the original data, fit a 
smooth curve, and choose from the curve a series of points with equi- 
distant abscissas. For such a set of points we define, in succession, the 
zero moment. At, the fiirst moment, /i', the second moment, ju", etc., of 
y with respect to x as 

= 2yAx = Axl^y 

At' = Sxt/Ax ~ AxSxy [74] 

At'' = 'Zx^yAx = AxZix^y^ etc. 

It is then assumed that these moments are related to the desired curve 
as follows: 

M = 


£ 


f(x)dx = AxSy 




xf(x)dx = Axhxy 


[75] 


At" = f x^ f{x)dx — AxLx^yy etc., 
U a. 


where a represents the lowest x-vaJue less and /3 the highest 

x-value plus J^Ax. If the desired equation is linear in x, only the first 
two equations of Eqs. 75 are used; if of the second degree, the first three 
are used; etc. Substituting for/(x) its equal, Eq. 73, and integrating, 
we obtain for the linear case 


a(iS — O') + 


h{f - o?) 

2 

hif - c?) 


= AxSy 


= AxZxy 


[ 76 ] 


O 


O 
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The values of a and 6 may then be obtained by solving Eqs. 76 simul- 
taneously. 

Equations obtained by this method deviate from those obtained by 
more reliable methods, the more so the fewer the number of points. 
Its use is not recommended, since it is faulty in theory and usually 
entails more computational labor than far more reliable methods. 

6. Successive Approximations. For cases where the desired equation 
is, or can be made, linear with respect to its arbitrary constants, the 
results obtained using one of the methods above may generally be im- 
proved by taking successive approximations. Let the equation, trans- 
formed if necessary to a form linear with respect to the arbitrary con- 
stants or functions of them, be written 

y = a + hx + cx^ '\ [77] 

and let the values for the arbitrary constants and the computed ^/-values 
calculated as first approximations, using one of the above described 
methods, be represented by primes, a', V, y'c, etc. 

Ordinarily, in accord with a suggestion made above, it will be advan- 
tageous to use rounded values for a', 6', etc., but not for the y'cS> com- 
puted with their aid. So doing greatly reduces computational labor. 

The procedure for obtaining a second approximation follows: (1) Com- 
pute for the various given a:-values the corresponding values of y — 

(2) Plot {y — as a function of x and fit, if possible, a smooth curve 
to the plotted points. Note that in this plot the distances of the points 
from the a:-axis represent deviations of the first approximation equation 
from the observed data, and that the distances from the plotted points 
to the curve represent deviations of the observed data from the second 
approximation equation which is to be derived. (3) If a curve can be 
fitted, obtain its equation, either by the method used to obtain 
yf ^ QY ] 3 y othcr suitablc method. (4) Add this correction 
equation to the first approximation equation to obtain the second ap- 
proximation equation. 

If a third approximation is needed, steps 1 to 4 may be repeated. If 
necessary, still further approximations may be made until the best pos- 
sible fit is obtained. This condition is attained when the curve obtained 
by step 2 coincides with the x-Sixis. 

On the other hand, the least-squares method may be used to obtain 
the second approximation equation. So obtained, it is identical with 
that obtained by least-squares treatment of the original data and cannot 
be further improved. This procedure, involving the obtaining of a first 
approximation by some simpler method as outlined above, which gen- 
erally lightens the computational labor connected with the method. of 
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least squares, and increases greatly the ease of detection of computa- 
tional errors, is further explained in Chapter XI. 

At the close of the discussion of the selected-points method, it was 
indicated that the equation there derived to represent the data of Table 
IV, namely 

y = 5.782x2) 

or in linear form for the undetermined constants, 

log y = 0.1388 + 0.2411a; + 2Mllx^ 

could be bettered to overcome certain deficiencies in fit. With this pur- 
pose in mind, let us attempt improvement by successive approximations, 
using the selected-points method. 

That Eqs. 64 and 63 fail to a certain extent is indicated in the last 
column of Table IV. To correct for the deviations shown, we seek an 
equation of the same form as Eq. 63 to represent (log y — log as a 
function of x. One first plot§, as in Fig. HA, (log y — log y'^ — fix). 
Then, selecting (0.3, —0.0052), (0.6,-0.0004), and (0.9,-0,0040) as 
probable points for the first approximation correction, one obtains for 
that correction 

^'(logy'c) = -0,0184 + 0’0580a; - 0.0467a;^ ‘ [78] 

Plotting next, as taken from the graph, the differences (log y — log y^c) 
— A' (log y' f) = fix) gives the distribution shown in Fig. 115, A second 
approximation correction seems desirable. Selecting the points 
(0.3,0.0006), (0.6,-0.0010), and (0.9,0.0006), the following second cor- 
rection equation is obtained: 

A" (log y'c) == 0.0054 - 0.0213x + 0.0178x^ [79] 

Plotting the new differences in Fig. IIC, one sees the possibility for a 
third approximation correction. For such correction, there is shown 

A'" ilogy'o) = 0.0015 - 0.0025^ [80] 

Whether or not this correction should be represented by a straight line, 
and if so, by the one indicated, is a matter of opinion. At any rate, that 
given can hardly be bettered with certainty without recourse to the 
least-squares method. 

Adding the three correction equations to Eq. ,63 one obtains the 
fourth approximation 

log2/""o = 0.1273 + 0.2753X + 2A%22x^ [81] 

and finally, writing 2/ in place of ^""c 

24 = 1.3406e^°*®^^"^ ^ [82] 


[64] 

[63]- 
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0.0 0.2 0.4 0.6 0.8 1.0 

X 

(C) 

Fig. 11. Graphs used to improve, by successive approximations, the fit of Eqs. 60 
and 64 in representing the data of Table IV. A, Bj and C are graphs leading to 
first, second, and third correction equations respectively. 



SUCCESSIVE APPROXIMATIONS 


79 


The next question concerns the extent to which the computed con- 
stants are significant. Their probable errors (see Chapter VIII) can- 
not be determined, though, as will be shown in Chapter XI, probable 
errors can be determined for constants obtained by the least-squares 
method. Here we must be content with estimates. Inspection of Fig. 
lie indicates that, at the most, reliance on computed values for log?/ 
to represent the measurements given in Table IV cannot exceed 0.0005. 
With log y varying from 0.12 for rr = 0 to 2.7 for x = 1.0, this means 
for dy/y, the differential of log y, a variation from about 1/240 to about 
1/5000. It is therefore desirable to include in the way of significant 
digits in the computed constants of Eq.‘81 only as many as will con- 
tribute l/5000th of the whole or more. For x — 1, where the value of 
log y is roughly 2.9, this means a A(log y) of 0.0006. To the extent of 
six in the ten thousandth place, it is to be seen that contributions are 
made by the last digits given in each of the computed constants, and 
that none could be made by additional digits had they been included. 
It follows that the computed constants for Eq. 81 are significant only 
to the extent shown. As to whether or not the coefficients of x and 
in Eq. 82 should be rounded off to 0.632 and 5.717, the answer is difficult, 
since these are borderline cases. 

The rather irregular nature of the distribution of plotted points as 
shown in Fig. 11 was largely responsible for the need of the unusually 
large number of approximations made before the final equation was ob- 
tained in the case illustrated above. Often, particularly if the data are 
highly consistent, only one approximation correction is needed. Con- 
sider in this connection data by Regnault as reported by Fowle.^ (Table 
VI.) The equation to be fitted is based on the extremely important 
thermodynamic relation known as the Clapeyron equation 

of which L is a heat of transformation, e.g., vaporization, from phase 1 to 
phase 2, and T, p, and v are, in order, temperature, pressure, and specific 
volume. The data selected concern the saturated vapor pressure of 
CCI4. (See Table VI and Fig. 12.) From the plot of log p = /(1/T), 
the first approximation equation, that of a straight line in accord with 
thermodynamic reasoning, is readily obtained. With rounded values 

1 Fowle, F. E., Smithsonian Physical Tables, 7th Revised Edition, p. 176, The 
Sraithsonian Institution, Washington, D. C., 1920. 
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TABLE VI 

The Sathkatbd Vapor Pressure of Carbon Tetrachloride CGU for Various 
Temperatures as Determined by Regnault and Reported by Fowls/ and 
Certain Computations to Illustrate the Successive Approximation Method 
OF Finding an Equation to Represent Given Data 


Tin 

V in 


Tin 

1 ^ 1 

1600 

w 

10® log - 
P 

°c 

mm-Hg 

XT 

1 mm-Hg 

°K 

T K" 

T 

1 mm~Iig 

55.0 

376.3 

2.57553 

328.16 

0.0030473 

4.87568 

2.57432 

121 

60.0 

447.4 

2.65070 

333.16 

.0030016 

4.80256 

2.64744 

326 

65.0 

528.7 

2.72321 

338.16 

.0029572 

4.73152 

2.71848 

473 

70.0 

621.1 

1 2.79316, 

343.16 

.0029141 

4.66256 

2.78744 

572 

75.0 

725.7 

2.86076 

348.16 

.0028722 

4.59552 

2.85448 

628 

80.0 

843.3 

2.92598 

353.16 

.0028316 

4.53056 

2.91944 

654 

85.0 

975.1 

2.98905 

358.16 

.0027920 

4.46720 

2.98280 

625 

90.0 

1122.3 

3.05010 

363.16 

.0027536 

4.40576 

3.04424 

586 

95.0 

1286.9 

3.10955 

368.16 

.0027162 

4.34592 

3.10408 

547 


for the constants, and hence no expectation of a close fit, we use as such 
the straight line 


log , ^ tt = 2.97 - 1600 °K f ^ - 0.00280 [ 34 ] 

Imm-Hg \T Il°/ ^ 

Values for this function are given in the next to the last column of the 
table. In the last column, headed 10^ log (p/p'), is shown the extent 
to which Eq. 84 fails to represent the data. These values are plotted 
in Fig. 12 . The points shown as o are seen on the magnified scale, 
which may now be used, to lie on a smooth curve which seems slightly 
off that for a second-degree parabola. Selection of a power series of the 

third degree in *- 0.0028 — ^ and using positions where the curve, 

if drawn, would intersect the ordinates at 0.0027, 0.0028, 0.0029, and 
0.0030 lead to the correction equation 

log ^ = 635 X ,10-® + 4.75 K° (~ - 0.0028 _ 7.5 x 10 ^ 

(I - 0.0028 —J- 125 X 10® - 0.0028 AJ [85] 


^ Idem. 
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That this correction equation has succeeded well is shown by the curve 
that has been drawn according to the equation. 



Fig. 12. A graph showing the saturated vapor pressure of CCh as a function of 
temperature- The straight line represents a rounded first approximation. The 
points plotted as small circles represent the failure of that approximation. How 
well the second approximation accounts for the failure of the first is shown by the 
fit of the third-degree curve of Eq. 85 which has been drawn. 


Equation 85 added to Eq. 84 yields the relation desired, namely 

log — = 2.97635 - 1595.25 K° ( h - 0.0028 ^ ) 

1 nun-Hg ti. / 

7.5 X 10* K°^ - 0.0028 

- 125 X 10® K°3 - 0.0028 


[ 86 ] 
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Differentiation of Eq. 86 and substitution in Eq. 83, once (^2 - ^^l) is 
known, leads to a desired heat of vaporization. 

7. Summary. Data which yield a smooth curve on plotting may often 
be profitably represented by an equation. For the empirical case, the 
problem of fitting an equatiqn to a set of data involves two steps: (1) 
finding a suitable form of equation to represent the data, and (2) obtain- 
ing suitable values for the arbitrary constants. For the rational case, 
the form of the equation is known from theoretical considerations, so 
that only step (2) is involved. 

For the empirical equation, there is no straightforward way of per- 
forming step (1) ; one can only guess at a suitable form from the shape 
of the curve representing the data. There are, though, methods of 
testing whether a particular guess is a good one. For most equations 
with only one or two arbitrary constants, a graphical test may be used; 
for equations with three or more arbitrary constants, a tabular method 
(Table 11) is often applicable. 

There are several methods for finding values for the arbitrary con- 
stants. The method of least squares (Chapter XI) is the most reliable, 
but generally the most laborious. Of the substitute methods, (1) the 
straight-line graph method may be used for most two-constant forms 
of equations as well as several three- and four-constant forms. It will 
generally give more accurate results with less labor than any other sub- 
stitute method for the ^wo-constant forms for which it is applicable. 
(2) The method of selected points may be used for almost all forms of 
equations but is most suitable for linear forms or forms which can be 
made linear with respect to their arbitrary constants. This method is 
generally the most accurate for equations with three or more arbitrary 
constants, and is especially recommended when successive approxima- 
tions are to be made. (3) The method of averages, a special selected- 
points method, may be used only for equations which can be written in 
a form linear with respect to the arbitrary constants. For the straight 
line case it is highly precise. It does not require the construction of a 
graph. (4) The method of moments is applicable only to equations 
expressing as a polynomial in a;, and is considerably less reliable than 
any of the other methods discussed in this chapter. 

When fitting equations which are linear with respect to their arbitrary 
constants, the results obtained by applying one of the above methods 
may generally be improved by employing successive approximations. 
Generally also, the time involved may be shortened by following from 
the beginning the procedure of u,sing for the first approximation only 
rounded values for the arbitrary constants. This method also provides 
a convenient way of simplifying .the least-squares procedure. 
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PROBLEMS 

1. The a-ray activity of a sample of radon, expressed in terms of its initial activity 
at the beginning of a test to determine its decay constant and half life, is found to 
have the following fractional values at the ends of succeeding 24-hour intervals: 
0.835, 0.695, 0.580, 0.485, 0.405, 0.335, 0.280, and 0.235. On the assumption that 
the activity obeys an exponential decay law, find the equation that represents the 
activity, and determine the decay constant and half life. 

2. Find a tabular suitability test for the equation 

ae~^^ 


3. Using the following data for the resistivity of tungsten as a function of tem- 
perature,^ find the equation for p = /(T). 


T 

p 

T 

P 


IJL ohm cm 

®K 

/i ohm cm 

1000 

25.70 

2500 

77.25 

1500 

41.85 

3000 

96.2 

2000 

59.10 

3500 

115.7 

The properties of 

many elements at elevated temperatures approximate (y/yo) = 

(T/Tq)^, hence try a In-ki or a log-log relation. 


4. The enaf of a standard Pt to (90% Pt — 10% Rh) thermocouple ^ as a functi<in 
of temperature when the cold junction is at 0.0® C is given as 

T 

E 

T 

E 

0^ 

C 0.000 mv 

1000® C 

9 . 569 mv 

200 

1.436 

1200 

11.924 

400 

3.250 

1400 

14.312 

600 

5.222 

1600 

16.674 

800 

7.330 



Apply the successive-differences test and determine how many terms in a power series 
in {T — 0° C) are needed to give a rather precise description of B = f{T — 0®C). 

Derive an equation of the form 



E 

= a(r-0°C) +HT 

-o°c)= + c(r 

- 0“ C)® 


to represent the data given. Form a table showing, for the temperatures given, the 
differences between the given emf's and your computed emf’s. 

5. Using the data of Problem 2, Chapter I, in which unsmoothed data were given 
for incandescent tungsten vacuum lamps relating percentage of normal voltage of 
operation to the temperature of the filament, compute a best curve of the type 

V / 2^ \ a(i + & log 

Tn^\¥n) 

1 Forsythe, W. E., and Worthing, A. G., Astrophys. J., 61, 153 (1925). 

2 Roeser, W. F., “Thermoelectric Thermometry,”' p. 194 of report of S3nxiposium on Temperature — 
Its Measurement and Control in Science and Industry, New York, Reinhold Publishing Corporation^ 
1941. 
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Use the method of successive approximations. Compare the results with those 
obtained by tabular smoothing. 

6. As the result of a porous-plug test for air, Roebuck reports that air, started 
with the first pressure-temperature condition shown, will assume the succeeding 
conditions shown on passage through a succession of porous plugs properly con- 
trolled. 


V 

T 

V 

T 

215. 8A 

O.OO^C 

128.1 A 

-10.80° C 

180.9 

-3.35 

109.7 

-14.02 

168,4 

-4.63 

91.2 

-17.69 

154.4 

-6.51 

73.5 

-21.56 

140.7 

-8.67 




Find the best pow^r series, using successive approximations, for representing these 
data. 

7. Graph carefully the data in the first and third columns of Table IV, p. 257, 
and, with the aid of Eqs. 52 to 55, determine the constants for an equation of the 
form 2 / = a sin (cat + 4) to represent the data. Compare your result with the least- 
squares result at the bottom of the table. 

8. With the result obtained in the previous problem as a first approximation, 
obtain a second approximation. 

9. Derive the criterion of tabular suitability for Eq. 10 of Table 11. 

10. The reflectance y of a certain porcelain enamel as a function of opacifier con- 
tent X, arbitrarily defined, as given by H. C. Arnold, is 


X 

yin % 

X 

'j/in % 

X 

yin % 

0.0 

63.00 

3,0 

68.30 

6.0 

70.60 

0.5 

64.30 

3.5 

68.80 

6.5 

70.80 

1.0 

65.35 

4.0 

69.30 

7.0 

70.90 

1.5 

66.15 

4.5 

69.65 

7.5 

71.00 

2.0 

67.00 

5.0 

, 70.06 

8.0 

71.05 

is 

67,70 

5.5 

70.30 




Obtain an equation with not more than three parameters to represent the data. 

11. Obtain an equation of the form Pt = fit) for the following tabulated values 
graphed in Fig. 4, p. 175. 


t 

Pi 

t 

Pt 

t 

Pt 

sec 

sec ^ 

sec 

sec"*^ 

sec 

sec ^ 

0.25 

0.708 

2.75 

0,070 

5,25 

0.008 

0.75 

.450 

3.25 

.055 

5.75 

.013 

1.25 

.284 

,3.75 

.035 

6,26 

.006 

1.75 

.192 

4.25 

.024 



2.25 

.138 

4.75 

.018 





CHAPTER IV 


TABULAR AND GRAPHICAL DIFFERENTIATION 
AND INTEGRATION 

1. Introduction. The solutions of many problems include finding the 
slope of a curve or the area of a closed figure. Of such great importance 
have these processes been historically that their solutions lead directly 
to the invention of the calculus. Mathematically the derivative, dy/dz, 

are involved. 

The function /(a:) is often known explicitly. Here, however, we are con- 
cerned principally with those that are not known. 

The derivative problem has already been encountered in Chapter 
III, where the slope of a straight line was required for the evaluation of 
one of the constants of an empirical equation. More often the slope 
itself is desired because of what it itself represents. 

Often, slopes that are desired are those of nonlinear curves as (1) in 
the field of chemical thermodynamics, where values of dE/dT are sought 
in order that we may obtain heats of reactions which proceed in voltaic 
cells, in accord with the Gibbs-Helmholtz equation, 

[ 1 ] 

of which A 17 is the change of internal energy, Q the quantity of elec- 
tricity transferred, E the emf of the cell, and T the absolute temperature; 
(2) in the field of electrical engineering, when the power loss, P, of a 
motor or generator is obtained by the retardation method, and values 
of du/dt are needed for use with the equation 

P = [2] 

of which I is the moment of inertia of the rotor, w its angular velocity, 
and dca/dt its angular acceleration; and (3) in the field of heat measure- 
ments, when the conductivity, k, of a metal in rod form is measured by 

. 85 ■ ■ , 


of a function, y = f{x), and the definite integral 


.r 
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the Biotj Wiedemann, and Franz method. Here the equation used is 



of which dQjdt is the rate of transfer of heat, dTJdl temperature gradient, 
and A cross-sectional area, 

Problems involving integrations are equally important and numerous. 
Typical examples occur (1) in the field of mechanical engineering, when 
the mean effective pressure in the cylinder of a steam engine is obtained 
from the area of an ^ indicator diagram^ ^ showing the pressure as a 
function of the position of the piston; (2) in the field of chemical ther- 
modynamics, when the absolute entropy, S, of a pure substance at the 
absolute temperature, T, is calculated, using the defining equation 




* / 
w 


of which Cp represents a specific heat and L a heat of transformation; and 
(3) in the field of electrical measurements, when the hysteresis energy 
loss per unit volume, TF, for a magnetic material is obtained from the 
area of its ^‘hysteresis loop,^^ using 



/ 


HdB 


[ 5 ] 


of which H represents magnetic field strength and B magnetic induction. 

There are numerous methods of solving both the slope and the area 
problem. Which method is best depends on the nature of the problem 
and the form in which the data are presented. If the data are available 
in equation form as y = /(x), the derived equation, (dy/dx) = fix), or 

the integrated equation, fyd,- FW, cm generaUy be obtained by 

mathematical differentiation or integration. Particular values of dy/dx 

for any value of x, or of J" y dx for any set of limits, can then usually 

be obtained with ease and with precision. When the data are presented 
in tabular or graphical form there are two possibilities. It may be best, 
and particularly is this so when a general expression for dy/dx or 

J ydx\s, desired, to find y = fx) empirically by the methods covered 

in Chapter III, and then to differentiate or to integrate mathematically. 
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However, if only a few particular values of dy/dx ot of J V 

wanted, or if the equation y = f{x) is too complicated, one of the 
graphical or tabular methods to be described may be preferable. 

2. Graphical Methods of Finding dyjdx. (a) Tangent and Normal 
Methods, The procedure for the graphical determination of the slope 
of a curve at a particular point, that corresponding to x say, consists 
of three steps: (1) plotting with considerable care the curve y = f(x)j 
(2) locating the line tangent (or normal) to the curve at x, and (3) cal- 
culating the slope of the curve. For the tangent 


% ^ 2/2 ~ Vi 
dx X2 — Xi 


where (xijyi) and ( 0 : 2 , 2 / 2 ) are two conveniently chosen points on the 
■^angent (or normal) line. 

Seemingly slight variations in the curve representing y = f{x) may 
result in large variations in dy/dx. For this reason it is important that, 
in step 1, one should follow with care the rules of good practice stated in 
Chapter II. It is especially desirable to have the tangent line at x in- 
clined at about 45® to the rr-axis. Also for greatest accuracy and con- 
venience, the points chosen for step 3 should be as far apart as is prac- 
ticable and should be intersections of the tangent (or normal) with main 
coordinate lines. 

There are several methods of performing step 2. The simplest method 
of locating the tangent line at x is that of slowly rotating a straight edge 
on the convex side of the curve about the point until it seems to be tan- 
gent to the curve. Much depends on good illumination. With prac- 
tice, rather accurate results may be obtained by this method. Per- 
formance is improved by the use of a transparent rule with a long nar- 
row scratch or cut on its under side. 

Some workers prefer to determine the dyjdx of a given curve by the 
indirect method, which involves first determining the normal. This 
method requires distinguishing between the geometric slope of a curve 
at a particular point and its physical slope. The former for the common 
plot of 2 / = /(x) at a particular point is the tangent of the angle which 
the tangent to the curve at that point makes with the x-axis. For a given 
function and a particular x, the value of the geometric slope varies with 
the scale choice. Its unit is the numeric one. The physical slope for a 
particular x^ however, does not change with the scale choice. Its value 

dyjdx. Its unit is that of y divided by that of x as, for example, 
cm/sec, K®/cm, etc. 
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With subscripts gc and gn referring to the geometric slopes of a curve 
and its normal, we may write 



correspondingly with subscripts pc and pn referring to the physical slopes 
of the curve and its normal, we may write 



■ Here (dy/5z)j a scale factor for the graph, is the ratio of a physical 8y cor- 
responding to a length measured along the y-axis to the physical 8x cor- 
responding to the same length measured along the rr-axis. As is apparent. 



Fig. 1. The Simons tangentmeter. Parts A, A are Incite blocks. B is a j&rst sur- 
face metal mirror. C, C are brass binding strips. D, D are machine screws. E is 
an index line perpendicular to mirror B scribed on the bottom of the lucite blocks. 

the introduction of the scale factor makes it possible for the equation to 
check dimensionally. Proof of Eq. 7a is left for a problem at the end of 
the chapter. 

Given Eq. 7a, the procedure for determining a physical slope follows. 
One first finds the position of the normal. A satisfactory method for 
doing this consists of placing a long narrow piece of plane, first-surface 
mirror across the curve, rotating it until the curve and its reflectiGn in 
the mirror form a smooth curve as shown by the ^ ^squint test^^ (Chapter 
II). The plane of the mirror is then normal to the curve. Though a 
short mirror may be used, a long one is preferred in order that the cal- 
culation of its slope may be as accurate as possible. Next, one deter- 
mines the scale factor in accord with the definition given above and then 
finally the physical slope, using Eq. 7a. 
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A convenient apparatus, which employs the normal principle yet per- 
mits of the direct determination of the physical tangent from the graph, 
is the tangentmeter (Fig. 1) de^ribed by Simons.^ The polished, plane, 
first-surface, metal mirror mounted betw^een the Incite blocks is first set 
nonnal to the curve. The scratch perpendicular to the mirror is then 
parallel to the desired tangent and permits determining dy/dx at once. 

In Chapter III it was noted that, if a graph of y = f(x) is to be used 
for determining the derivative dyjdx, one should select scales for plot- 
ting which give an approximate geometric slope of unity. We can now 



Fig. 2. A graph showing that greater precision for determining a dy/dx is possible 
when the geometric slope is approximately unity than when it deviates considerably 
from this value. 

show why this is the case. Consider the determination of the dy/dx^s 
at p and q, corresponding points on the two curves of Fig. 2 with geo- 
metric slopes of approximately 1 and using the normal method. 
Obviously their relative accuracies will depend on the accuracies with 
which the geometric slopes of the normals may be obtained, and these 
in turn on the accuracies with which the lengths ac, 5c, d/, and ef may 
be determined. Given that ab and de are of equal lengths and that the 
xmcertainty in the other linear measurements is a certain small amount, 
say 0.2 mm, it is obvious that the relative accuracies of the two dy/dx^s 
wiU depend most of all on the relative accuracies of the measurements 

^ Simons, H. P., Ind. Eng. Chem. (Anal. Ed.), 13, 563 (1941). See also Latishaw, 
J. J., Aw- Chem. Soc., 47, 793 (1925). Richards and Raspe, Science^ 71, 290 (1930). 
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of ac and df and that the accuracy for the determination of dy/dx at p 
is greater than at q. Just how much greater will depend on principles 
to be discussed later in Chapter IX. 

( 6 ) Secant Method. For a possibly greater accuracy than that yielded 
by the tangent or the normal methods, the secant method may be used. 
In this instance the slope of the tangent line is obtained as the limiting 
position of the secant line drawn through {x^y) and nearby points Pi, 
P2, etc., as P approaches x. For this purpose, four or five or more posi- 
tions of P are chosen. It is convenient to let the values Ai:r, A2rr, A^x, 
etc., representing changes in x in passing from (x,y) to points Pi, P2, 
etc., be multiples of a chosen Ax. Let the corresponding changes in y 
be Aiy, A2t/, etc. The quotients Aiy/Aix^ A22//A2X, etc., representing 
slopes of secants passing through the point {x,y), are then plotted as a 
function of x or of Ax, and a curve giving Ay /Ax = /(Ax) is drawn. 
The value of Ay /Ax for Ax = 0 is, of course, the dy/dx desired. With 
values for x and y taken from a suitable table, the only graphing that 
may need to be performed is that showing Ay/ Ax = j{x). The points 
Pi*i P2, etc., need, not all be on the same side of the point (x,y). 

Illustrating the secant method, consider the data of Table I showing 
the pyrometer current. Ip, of a certain disappearing filament optical 

TABLE I 

The Pyeometek Ctjerent, Ip , of a Ceetain Disappeaeing Filament Pyeometer 
FOR Disappearance Against a Background at Various Spectral Bright- 
nesses, B\ (X = 0.665ac), Expressed in Terms of qB\ for a Black Body at the 

Gold Point, 1336° K 


oSk 

Ip in ma 

1 

log — 
ol5X 

log Ip 

log Ip - log IpO 

A log Ip 

. 1 ®>- 

“‘“'a 

0.125 

193.8 

• --0.9031 

2.2873 

-0.1141 

0.1263 

0.250 

210.8 

-0.6021 

2.3238 

- .0776 

.1288 

0.500 

230.1 

-0.3010 

2.3619 

- .0395 

.1312 

1.000 

252.0 

0.0000 

2.4014 

.0000 

.... 

2.000 

277.1 

0.3010 

2.4426 

.0412 

.1369 

4.000 

305.8 

0.6021 

2.4854 

.0840 

.1395 

8.000 * 

338.5 • 

, 0.9031 

2.5296 

.1282 

.1420 

16.000 

376.0 

1.2041 

2.5752 

.1738 

.1444 

32.000 

419.5 i 

1.5052 

2.6227 

.2213 

.1470 

64.000 

470.2 1 

1.8062 

2.6723 

.2709 

.1500 
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pyrometer as a function of the spectral brightness, B\, of a source of 
light. Let us find {dIp/dB\) for the pyrometer lamp when 

matching a black body background at the gold point. The quantity 
sought is the slope of the curve log Ip = /[log (Bx/o-Bx)] at log (Bx/qBx) 
= 0. 

Computed values for A log Ip/ A log (B\/oB\) are included in Table I. 
These values are graphed in Fig. 3. For log (B\/oB\) = 0.000 the slope 



- 0.8 - 0.4 0.0 0.4 0.8 


Fig. 3. lUustrating, with the aid of the data of Table I, the secant method for the 
precise determination of a slope. The slope sought is that of (B\/Ip)(dIp/dB\) 
for log (Bx/ojBx) = 0.000. 

is seen to be 0.1341, Generally the inverse of {B\/Ip)(dIp/dB\) is de- 
sired. This inverse value is 7.45, and states that for a black body at 
the gold point the spectral brightness at X = 0.665^ varies 7.45% for a 
1.00% variation in the matching pyrometer current. The work required 
is considerable in comparison with that required by the tangent or the 
normal method. 

There are mechanical devices for evaluating dy/dx from a plot of 
y =1 and other devices which automatically draw out the curve of 
dy/dx = f{x) when their tracer arms are made to follow the y = f{x^ 
curve in a particular manner.^ Such instruments are rather compli- 

^ Evans, D. L. C., Engineering, 144, Sept. 3, 1937. 

2 Lipka, J., Graphical and Mechanical Computation, p. 255, New York, John Wiley 
& Sons, 1918. 
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Gated to use, however. They yield no increase in accuracy, but are very 
valuable as time savers in certain specialized routine problems. 

3. Tabular Methods of Finding dyjdx. When the tabulations are 
precise, these methods equal, or are superior to, graphical methods in 
accuracy, and permit the calculation of derivatives of the second and 
higher orders directly from the original data. The necessary equations 
are obtained by differentiating the interpolation formulas of Chapter I. 
Thus, the Gregory-Newton formula (Eq. 7 of Chapter I) expresses 
y = j{x) in terms of the successive differences of y obtained from a 
table of y = f{x) as 

V 2/0 '+ nhyo + 2\ 


Here (a;o,2/o) is a tabulated point near {x^y)j Ao; is the constant tabular 
a;-interval, and n is defined by 


n 


X — Xq 

Ax 


[9] 


The terms Ayo, A^yo, etc., are the first, second, etc,, order of differences 
of the tabulated y’s (see Chapter I). There follows 


Hence, 


dy 

dx 


^ f == ( (l\ 

dx \dn/ \dx/ \dn/ \Ax/ 

-[A2/o+(2n-l)(^) 

+ (3n^ — 6n + 2) 

+ - 18n^ + 22n - 6) (— -{ 


[ 10 ] 


[ 11 ] 


With Ax negative and x < Xq, one uses an upward slanting set of A’s 
(see Table II) of which the signs of the Ay, A%, A^y, etc., differenges 
will be changed, but the signs of the A^y, A^y^ etc., differences will be 
unchanged. 

An example illustrating the method follows. 

Example. From the values for y = /(x) = logx, given in Table II, 
find dy/dx for X = 1.726. 
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TABLE II 


Showing Seveeah Values for y = S{x) — Log x foe a Limited Range of x and 
Their Successive Differences A^, Etc. 


X 

y 

Ay 

. o 

A-y 


A^y 


1.0 

0.00000 

0.17609 





1.5 

.17609 


-0.05115 






.12494 


0.02312 



2.0 

.30103 

.09691 

- .02803 

.01030 

-0.01282 

0.00802 

2.5 

.39794 

.07918 

- .01773 

.00550 

- .00480 

^ .00257 

3.0 

.47712 

.06695 

- .01223 

.00327 

- .00223 

.00108 

3.5 

.54407 

.05799 

- .00896 

.00212 

- .00115 


4.0 

.60206 

.05115 

- .00684 




4.5 

.65321 






5.0 

1 .69897 







As xq we select 1.500 and as Ar, 0.500. There follows from Eq. 9 


1.726 - 1.500 ^ 

= 0.452 

Ax 0.500 


Substituting into Eq. 11, 3 del(is 

(^ ) = 0-12494 + (2 X 0.452 - 1) 

\dx/ 1.726 0.500 L 


-0.02803 


-f (3 X 0.452^ - 6 X 0.452 + 2) + • 


= 2.000(0.12494 -f 0.00135 - 0.00017 - 0.00014 • • -) 
The final result depends on the number of terms included: 


Number of Terms 

dx 

Correction 

1 

0.24988 

+0.00174 

2 

.25258 

- .00096 

3 

.25224 

- .00062 

4 

.25196 

- .00034 


[ 12 ] 


[ 13 ] 



94 


DIFFERENTIATION AND INTEGRATION 


4. Tabular Methods of Finding 




dx. There is a wide choice of 


tabular methods for finding areas and the final equations — the so-called 
quadrature formulas. To data in graph form, they may be applied 
with the same ease that attends their application to tabulated data. 
In fact, their significance and use are best shown graphically. 

rxp 

(a) Trapezoidal Rule. The value of the integral j ydx which we 


seek is represented in Fig. 4 by the area xiAPxpXi. Except for a re- 
mainder Xp — Xn in width, let this area be subdivided, as shown, into 



Fig. 4. Illustrating the derivation of the trapezoidal rule and of Simpson^s H rule. 

(n-1) strips of equal and convenient width, AXj by ordinates at Xij 
^ 2 , * * * The approximation is made such that between two suc- 
cessive intersections of the curve with the ordinates, such as the points 
A and B, the curve may be replaced by a straight line without appre- 
ciably changing the area of the strip. Hence, by the trapezoidal rule, 
the area of the strip XiABx 2 Xi is taken sls Ax (yi + 2 / 2 ) /2, and the area 
under the curve as the sum of the areas of (n — 1) such strips, plus the 
remainder of width x^Xp, or 

f = ^\^ + yz + ys^ hy„-i + ^ 

+ (», - [M] 

It is apparent that the smaller the value of the interval Az, the closer 
the value given by the rule approaches the true value of the integral. 
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As Ax decreases, however, the number of ordinates to be added together 
increases, so that unless an adding machine is available, the work be- 
comes more tedious and chances for error increase. When the data are 
given in tabular foim, Ax cannot be taken smaller than the a;4nterval 
of the table, so that one of the other formulas must be used if an approxi- 
mation better than that given by the trapezoidal rule is desired. 

(b) Simpson^s 14 Rule. Let the area desired be subdivided, except 
possibly for a remainder at one end whose area, 5^, may be found other- 
wise, into an even number of strips of equal width, Ax, by ordinates at 
xi,X 2 • • • as in Fig. 4. The assumption is then made that between 
points A and C the curve may be replaced by a parabola of the second 
degree passing through points A, B, and C without changing appreciably 
the area of the two strips underneath. On the basis of this assumption, 
it can be shown that the area of these two strips is Ax{yi + 4^2 + yz)/^- 
Hence, by Simpson’s }4 the desired area is the sum of {n — l)/2 
such double-strip areas, or 

dx = ~ 42/2 + 2yz + 4^4 + • • • + 42/„_i + y^) + 

= -y [(2/1 + Vn) + 2(2/3 + 2/5 H ) + 4(2/2 + 2/4 H )] 

+ Xn){yn + Vp) [ 15 ] 

Simpson’s rule will usually, but not always, 3deld a closer approxi- 
mation to the actual area sought than will the trapezoidal rule using the 
same Ax. When the data for the interval over which the integral is to 
be taken are given an odd number of strips, Simpson’s rule may be 
used for all but the last strip, whose area may then be combined with 
that represented by Sr and calculated by the trapezoidal rule. 

(c) Simpson^ s ^ Rule. By reasoning similar to that for the }4 rule, 
it can be shown, if the area imder the curve y = fix) is assumed sub- 
divided into {n — 1 ) strips of equal width, Ax, where {n — 1 ) is now 
divisible by three, and it is further assumed that the curve above any 
three adjacent strips approximates a third degree parabola, that the 
formula known as Simpson’s ^ rule becomes applicable. In algebraic 
form it states 



71 g At 

ydx = — [(yi + yn) + 2(2/4 + 2/7 + yio + • 


+ 3(^2 + 2/3 + 2/5 + 


ni„ _ 4 _ , . . M 


For a given value of Ax, Simpson’s % rule will usually, but not always, 
give a closer approximation than Simpson’s rule. 
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{d) Weddle's Rule, By subdividing the desired area into a number of 
strips divisible by some integer m, and approximating the curve above 
m such adjacent strips by an mth degree parabola, it is possible to ap- 
proximate curve boundaries more closely than is possible with the sim- 
pler trapezoidal and Simpson^s rules. One such procedure known as 
Weddle’s rule is obtained by simplifying somewhat the general formula 
for m == 6. It states that 


ydx ^ ^ 2/n) + 5(2/2 + 2/6 + ^8 + 2/12 + 2/14 H ) 

+ (2/3 + 2/5 + 2/9 + 2/11 + 2/16 H ) 

+ 6(2/4 + 2/10 + 2/16 H ) 

+ 2(2/7 + 2/13 +' 2/19 H )] [17] 

The increased chances for error in using this equation are evident. 
Eew cases justify the use of this rule rather than one of the simpler rules. 

(e) Illustrative Example, Let us consider the results which these va- 
rious quadrature formulas yield when applied to a particular case. For 
this we choose theoretically computed values for spectral black body 
radiancy, any given temperature, expressed in terms of the maxi- 
mum, as a function of the product of wave length and tempera- 

ture \T, The values of (R\/(R\msLx for various XT values as given by 
Lowan and Blanch ^ are' given in Table III. 

TABLE III 

Showing ( R \/ CR\max roR Black Body Radiation as a Function of \T 



XT in cm K® 

d?x 

XT in cm K° 

d?x 

max 

1 

(Rx max 

0.08 

0.0014 

0.22 

0.8188 

.10 

.0167 

.24 

.9139 

.12 

.0735 

.26 

.9719 

.14 

.1880 

.28 

.9974 

.16 

.3476 

.30 

.9968 

.18 

.5230 

.32 

.9765 

.20 

.6860 




1 Lowan, A. N., and Blanch, G., Optical Soc. Am., 30, 70 (1940). 
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For the average the range 0.08 cm K° < XT < 0.32 

cm K° as expressed by 

the trapezoidal rule, the Simpson 'the Simpson % rule, and the 

Weddle rule in order yield 0.5852, 0.5854, 0.5853, and 0.5855, all of which 
are close to the value 0.5854 which is yielded by more precise calcula- 
tions using smaller intervals. That the trapezoidal rule should have devi- 
ated most from the true average is to be expected, but that the Simpson 


/ 


’0.32 cm K® 


(Rx 


0.08 cm K° I 


d(\T) [18] 



Fig. 5. To find the area of ABCDj the lengths 2 / 2 , ys ■ may be substituted into any 

quadrature formula. 

should have come closest is hardly to be expected. The com- 
parison supports the fact that often, and especially where Ax is small, 
the simple trapezoidal rule will frequently yield results as accurate as 
the data justify. Only rarely is it necessary— and hence desirable — to 
use any formula beyond the easily, remembered Simpson^s nile. This 
conclusion is commensurate with that reached in Chapter III, where it 
was found that short portions of most curves can be represented em- 
pirically by second-degree parabolas. 

When the area of an irregular closed figure such as that of Fig. 5 is 
to be measured by one of the quadrature formulas, we may divide the 
figure into the proper number of strips by the parallel equidistant lines 
at xij X 2 , • • • Xn, and then substitute the lengths of these lines into the 
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formula used. This procedure is equivalent to subtracting the area 
xiADCxnXi from the area xiABCxnXi. 

6. Graphical Methods of Finding ydx. {a) Polar Planimeter 

Method, There are many mechanical devices for measuring areas. Most 
of them, provided the data are once satisfactorily graphed, are more 
rapid than using quadrature rules. Further, they are sometimes more 
accurate, especially so when the desired area has very irregular bound- 
aries. The instruments range from the extremely simple hatchet plani- 
meter ^ to such complex mechanisms as that which automatically inte- 
grates the product of two empirical functions in a few seconds.^ Be- 
tween these extremes, the polar planimeter is probably the most suitable 

Q 



Fig. 6. A diagram showing the main characteristics of the polar planimeter. OQ 
represents the pivot arm pivoted at 0, QP the tracer arm with tracer point at P, 
and W the recording wheel. 

compromise with regard to simplicity, applicability, cost, availability, 
and accuracy. There are several forms of polar planimeters, differing in 
minor details of construction and refinement, but the essential parts of 
the instrument (Fig. 6) are (1) the polar arm, OQ, with a point 0 which 
is maintained fixed during an operation; (2) the tracer arm, QP, adjust- 
able usually as to length, which is hinged to the polar arm at Q and 
terminates at one end in a tracer point P; and (3) the recording wheel, W. 

To measure an area with the polar planimeter, the following steps are 
performed: 

1. Locate the fixed point, 0, so that in tracing the figure, the wheel, 
TF, does not go ofi the edge of the paper, or over any folds or other 
irregularities; the more uniform the surface on which the wheel rolls, 
the greater the possible accuracy of the measurement. 

2. Place the tracer point, P, on the perimeter of the area, noting 
• the reading of the recording mechanism attached to the integrating 

wheel. 

1 Haynes, F. B., and Haynes, I. C., Reo. Sai. Instruments, 2, 396 (1931). 

^Sears, F. W., /. Optical Soc. Am., 29, 77 (1939). 



99 


GRAPHICAL METHODS OF FINDING f y dx 

3. Trace the boundary of the figure carefully until the starting 
point is reached once more (this is important), and note the new read- 
ing of the recording mechanism. 

4. Subtract the two readings to obtain the number of rotations of 
the wheel. 

5. Multiply the number of rotations so obtained by the calibration 
constant to obtain the area measured. This constant may be calcu- 
lated from the dimensions of the instrument by Eq. 19 below, or it 
may be found by noting the number of rotations produced in tracing 
a figure of kno\^m area, such as a triangle or a rectangle. 

More reliable values for areas using a polar planimeter are obtained 
if the figure is traced a number of times — five say. It may also help to 
trace the figure five more times in a direction opposite to the first, and 
to average the results thus obtained. If proper precautions as to their 
locations are taken, a straight edge or a transparent drawing curve that 
coincides with the boundary of the figure measured for a reasonable 
distance may be used as a guide for the tracer arm point. Other sug- 
gestions concerning the use and care of the polar planimeter may be 
found elsewhere. 

That the number of rotations of the integrating wheel is directly pro- 
portional to the area traced is easily shown. Consider the three move- 
ments for the tracer arm shown at J., Bj and C, Fig. 7. In A, the arm 



i 

(B) 


(O' 


Fig. 7. Diagrams showing areas swept out by the tracer arm of a polar planimeter 
during each of the three possible elementary motions. 


moves a distance ds at right angles to its length, L The area swept 
out is Ids; and, if r represents the radius of the integrating wheel, the 
angle through which the wheel rotates is dd {= ds/r). In S, the arm 
moves parallel to itseK. The area swept out is zero; so also is the angle 
through which the wheel rotates. In C, the arm rotates about a fixed 
end. The area swept out is j^Pda; the angle d<t> through which the in- 
tegrating wheel rotates depends on its position with respect to the fibced 
end. In any case it is proportional to da and may be written Sis c da. 

All motions, no matter how complicated, that are possible for the 
tracer arm of a polar planimeter as used (Fig. 8), may be viewed as a 
combination of infinitesimal motions similar to those of A, 5, and C of 
Fig. 7. If, for such a motion, we add the condition that at the end of 
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the movement the tracer arm shall occupy its intitial position, we have 
the result, taking account of the vector nature of 4>, that the sum of the 
d.^>’s, all of which have taken place about the Q end of the arm, is zero. 
In actual instruments this condition is assured by having end 0 (Fig. 6) 
of the polar arm fixed so that the Q end of the tracer arm is limited to the 
arc of a circle. It follows, when an area is traced, that the integrating 



Fig. 8. A diagram showing several successive positions of the tracer arm of a polar 
planimeter when, with the fixed point of the polar arm at 0, the tracer point is 
moved aroimd the area abcdefga. During this movement, the whole of the enclosed 
area is swept out by the tracer arm in the same direction, namely, counterclockwise, 
and only once. The cross-hatched area, however, is swept out twice, once clock- 
wise and once counterclockwise. 

wheel will show only the vector sum of a number of dffs. We see at 
once that the area A is given by 

A = 'EdA = IrEdd = IrS [19] 

In actual use, it is customary, though not necessary, to move the tracer 
point counterclockwise about the area to be measured, and to reckon 
as positive an area that is swept out by counterclockwise rotation of 
the tracer arm about the end which is limited in motion to the arc of a 
circle. 

It is interesting to follow through the motions of the tracer arm in 
Fig. 8, and to see what area has been measured. Let abcdefga be the 
area traced out by tracer point P. As the tracer arm takes the suc- 
cessive positions aa', 66', cc', etc., back to aa', the area that is cross- 
hatched is swept over first clockwise and then counterclockwise. In 
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the summation, of dA^s this area yields zero. Only the area ahcdefga is 
swept once, and all in the same direction. Hence the A of Eq. 19 refers 
to this area only. In certain irregular areas, portions of the enclosed 
area to be measured may be swept out three times, or five times, or 
some odd number of times, but never an even number of times. More- 
over, the net effect of the sweepings in excess of one for these portions 
are always in directions such as to annul one another in pairs. In 
effect, eyen in these very irregular areas, the tracer arm sweeps the 
enclosed area only once, and all in the same direction. 

A slight difficulty arises in the use of a polar planimeter when, in 
sweeping out the area with the tracer point P, the point Q at the junc- 
tion of the two arms describes a complete circle about the fixed point 0. 
When QP is less than OP and for most other cases, area A is then given by 

A == Its + ir{R^ + Z^) [20] 

of which R is the length of polar arm OQ, and 6 the angle through which 
the recording wheel turns in consequence of motions described in Fig. 
7A only. It is not the total angle through which the wheel has turned. 
It is that angle less the angle 4> which corresponds to a = 2 tv radians. 

(6) Average Ordinate Method. This method, like the polar planimeter 
method, requires that the data be graphed. It is not suitable for the deterr 
mination of all areas. Practically it is limited to cases where the whole 
area can be broken up into several paraUel-sided approximations to trap- 
ezoids such as were assumed for the various above-listed tabular methods 

for J' ydx. For such cases, it combines with high accuracy the 

simplicity of the inaccurate counting squares procedure. 

The method can best be described in connection with an application. 
Fig. 9 shows a temperature-time curve for a standard compensated-loss 
calorimeter such as might be obtained when, with its aid, one seeks to 
determine the amount of heat lost by a heated specimen of material on 
cooling from some high temperature to that of the calorimeter. The 
fore interval is'the period previous to the receipt of the heated specimen 
and during which stirring of the calorimetric fluid is principally respon- 
sible for the change of temperature. The test interval is the period 
during which heat is transferred to the fluid by the heated specimen and 
a near equilibrium of temperature is being established. The after inter- 
val is the final period during which temperature variations are a com- 
bined result of stirring and of Newtonian leakage. One seeks the tem- 
perature interval Tc — This involves finding the area Vbdd'V. 

The approximations to trapezoids which we will use here are those 
determined by the 0C° line, the temperature-time curve, and the ordi- 
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nates at 4, 6 , 8 , 10, 12 , and 14 min. We first locate a straight edge so 
that it passes through the intersections of the 4-min and the 6 -min 
ordinates with the temperature-time curve. Then on the 5-min line 
we locate the point m which is two-thirds of the way from the straight 
edge to the curve. Insofar as Simpson^s 3^ rule is applicable, m'm is 
the average ordinate for the^ area between the 4-min and the 6 -min 
ordinates. Next in order points n, o, p, and q are located similarly, and 
similarly they represent the upper limits of other average ordinates. 



Time in Minutes 

Fig.. 9. The temperature-time curve for a standard, compensated loss calorimeter to 
which a heated specimen of material has been transferred. 

The upper limit of the average ordinate for the area between the 4-min 
and the 8 -min ordinates is now determined. It is the point r on the 
middle or 6 -min line where that ordinate is cut by a straight line between 
m and n. Similarly s is the upper limit of the average ordinate for the 
area between the 8 -min and the 12 -min lines. On the same basis, posi- 
tion t on the 8 -min ordinate is the upper limit for the average ordinate 
for the area between the 4-min and the 12 -min lines. The area between 
the 12-min and the 14-min lines may be similarly combined with the 
area associated with point t. Since, however, the time width of this 
area is only one-fifth that of the combined areas, one must select, on the 
straight line passing through t and q, a point u which is but one-fifth of 
the way from t to q. Accordingly the ordinate u'u is the average ordi- 
nate for the area between the 4-min and the 14-min ordinates and the 
area sought is 422 min C®. How this may be used in determining 
Tc — T 5 will be found elsewhere. 
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Depending on the scale and the care used, this method is susceptible 
of high precision. If the data are available in the form of an acceptable 
curve rather than in a tabulation of ^/-values for equal x-intervals, this 
method might well be superior to aU other methods, particularly if 
time is a factor. 

(c) Cut-and-Weigh Method. If the figure whose area is desired is cut out 
and weighed, its area can be found by dividing its weight by the weight 
per unit area of the paper on which 
it is drawn. Obviously this pro- 
cedure would make the figure unfit 
for any further use, so that in prac- 
tice the outline of the figure is traced 
onto a second sheet, preferably of 
heavy paper or metal foil, which is 
then cut and weighed. Errors may 
arise in faulty tracing, cutting, and 
weighing, and through nonuniform- 
ity of surface density of the heavy 
paper or foil. This method is rela- 
tively inaccurate. For rough work, 
it may prove convenient if a polar 
planimeter is not available. 

(d) Photoelectric Method. A photo- 
electric device for measuruig areas 
developed in part by the Botany 
Department of the University of 
Chicago is now offered commerci- 
ally by the American Instrument 
Company. Light from a low-voltage lamp (Fig. 10) is made parallel 
by a condensing lens, and then focused by a second lens onto a barrier 
layer photocell. The output of this cell is balanced in a suitable bridge 
arrangement by the output of a second cell, illuminated by the same 
lamp. The object whose area is desired must be opaque or translucent 
and must fit into a lO-inch circle. It is placed into the parallel light 
beam, thus reducing the output of the first photocell. The bridge 
circuit is then rebalanced by adjusting a slide-wire resistance which is 
calibrated directly in units of area. Advantages claimed by the manu- 
facturer are high accuracy, high speed, and no required operator ex- 
perience. 

6. Summary. Methods other than those of differential and integral 
calculus are often desirable for obtaining values of dy/dx and f y dx. 



Fig. 10. A photoelectric device for 
measuring areas. {Courtesy of the 
American Instrument Co.) 
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To find dy/dx at the point (x^y) when the data are presented graphi- 
cally, we may determine the slope of the tangent (or sometimes of the 
normal) line, or obtain it by the more laborious and more exact secant 
method. The slope of the tangent line, and hence of the curve, is given 
by 



[ 6 ] 


where {xi,yi) and (x 2 , 2 / 2 ) are two points on the tangent line. 

If the slope of the curve at a specified point is to be obtained from 
the slope of the normal to the curve at that point, the equation to be 
used is 

\dx' 

\dX/ curve / dy\ 

Xdx/novm&l 

of which (dy^dx^), a scale factor for the graph, represents the ratio of the 
change in y corresponding to a length measured along the ^/-axis to the 
change in x corresponding to the same length measured along the rr-axis. 

When the secant method is used to determine the slope of a curve at 
a specified point, the slopes of various secants, all of which cut the curve 
at that point, are graphed as a function of Ax, the change in x in going 
from one point of crossing to the next.' The secant slope for Ax == 0 is 
the slope desired. It is convenient for data in tabular form. 

When the data are tabulated, we may use the equation 




where (xo,2^o) is a tabulated point, A 2 / 0 , A^yo> etc., , are successive tabular 
differences, Ax is the common tabular x~interval, and n = (x xo)/Ax. 




To find / y dxy we may use one of the quadrature formulas for 


either tabular or graphical data. Important rules and formulas, are 
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(1) the trapezoidal rule: 


A = y dx = Ax(^ + y2 + ya -i h Vn-i + 


[14] 


(2) Simpson’s 3^ rule: 
, Ax 


liyi + yn) + 2(2/3 + 2/5 H ) + 4(2/2 + 2/4 H )] [15] 


(3) Simpson^s % rule: 
3Ax 


A = — [ivi + yn) + 2 ( 2/4 +* 2/7 + 2/10 +* 


0 


(4) Weddle's rule: 

ZAx . , 


+ 3(2/2 + 2/3 + 2/5 + 2/6 ^ )] [16] 


A = — [( 2/1 + yn) + 5(^2 + 2/6 +‘ 2/8 + • 


•) 


•) 


[17] 


+ ( 2/3 + 2/5 + 2/9 + 2/11 +• • 

+ 6(^4 + 2/10 + 2/16 ■! ) 

+ 2 ( 2/7 + 2/13 + 2/19 H )] 

Measurement with, a polar planimeter is a second method of finding 
^ y dx. Although especially well suited for measuring irregular areas, 

the planimeter may be used for all graphical data as well as for tabular 
data if these are first plotted. In “emergencies,” or for rough work, the 

cut-and-weigh method may be used for finding fydx. 


PROBLEMS 

1. Using the plot containing three curves drawn in connection with Problem 2 of 
Chapter II, constmct with care a graph showing TdB/BdT — fiT) for tungsten for 
the range 2000® K < !r < 3000® K. Use the straight edge tangent or normal 
methods. Use different symbols for values obtained from the three different curves. 
What is your conclusion as to probable accuracies for the three sets of values? 

2. Using the data reported in Problem 2 of Chapter II, determine with the aid of 
a tabular method the value of TdB/BdT for tungsten at 2000° K, 2200 ° K, 2400° K, 
2600° K, 2800 ° K, and 3000° K. Compare these values with those obtained in con- 
nection with Problem 1 above. 

3. Repeat Problem 2, noaking use of the graphical secant method. 

4. Using the data given below for the spectral brightness of a black body at 2400° K 
as a function of wavelength, determine its brightness at that temperature using 
(1) the tabular trapezoid method using a 0.01 /t interval, (2) the tabular trapezoid 
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method using a 0.02 ju interval, (3) the tabular Simpson’s H method, and (4) the 
graphical polar planimeter method. For (1), (2), and (3) use an adding machine if 
available. How do the four determinations check? 


X in 

_ . candles 

Bx m 2 

cm^ M 

X in 

^ . cand 
Bx m — ;r 
cm" 

0.41 

0.09 

0.61 

619 

.42 

0.38 

.62 

506 

.43 

1.36 

.63 

379 

.44 

3.30 

.64 

268 

.45 

6.59 

,65 

175.5 

.46 

12.45 

.66 

106.0 

.47 

22.4 

.67 

59,2 

.48 

40.0 

.68 

33.3 

.49 

69.6 

.69 

16.95 

.50 

124,0 

.70 

8,95 

.51 

221 

.71 

4.80 

.52 

358 

.72 

2.50 

.53 

487 

.73 

1.30 

.54 

606 

.74 

0.65 

.55 

706 

.75 

0.32 

.56 

786 

.76 

0.17 

.57 

828 

.77 

0.08 

.58 

830 



.59 

791 



.60 

716 




6. Prove the relation expressed by Eq. 7a. 

6. Using the data of problem 8, p. 268, determine, to within 1 part in 100,000, the 
ratio of the mean (0° C to 100® C) calory to the 15® C calory. 

7. Show, for the case of a parabolic curve of the form ?/ = a + + cx^ passing 

through the points A, B, C of Fig. 4, that the area included within the boundary 
xiAcxzxi, in accord with Simpson’s M rule, is given by Ax(yi + 42/2 + 2 / 3 ) /3* 
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FOURIER SERIES 

1. Introduction. A Fourier series is a convergent infinite series com- 
posed of sine and cosine terms whose successive angular values are pro- 
portional to the cardinal numbers, thus; 

ho 

y = /( 0 ) = Oj sin 6 (I 2 sin 26 03 sin 35 d- • ■ d* 

“h 61 cos 6 “h 26 -f* 63 cos 30 -j- * • • 
h ^ A 

= 77 + (om sin m5 + hm cos m5) [ 1 ] 


Some authors use bo not bo/2 for the constant term. The reason for the 
present use will appear later. That certain series of this type could be 
developed was known long before Fourier’s time, but certain of their 
properties as well as their possibilities in the solution of problems in the 
field of heat were not then appreciated. Fourier’s views, first presented 
to the French Academy in 1811, were published in 1822 in his Theorie 
analytique de la chaleur. 

Fourier series represent means whereby a very large number of prob- 
lems of certain types may be solved. In such instances, their value lies 
in the fact that with their aid boundary conditions, even when highly 
complicated, may usually be expressed in forms which are compatible 
with the underljdng differential equations of Laplace and of Poisson. 
Given the boundary conditions as to temperature for a sheet, a rod, or 
a block of material, certain of its physical characteristics, such as den- 
sity, specific heat, and thermal conductivity, and the distribution of 
temperature throughout at some one instant, it is generally possible to 
specify with the aid of these series the distribution of temperature 
throughout thereafter. In case, however, the distribution of tempera- 
ture at some instant cannot be ascertained, it is stiU possible to specify 
the steady state distribution. Analogous problems in acoustics, radia- 
tion, and electricity may be handled similarly. 

Industrial applications occur wherever vibrations are a matter of 
concern, as in the fields of electrical engineering, aerodynamics, teleph- 
ony, music, radio, and sound projection. The designer for electrical 
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generators and transformers must meet a requirement of noninjurious 
harmonics (vibrations, multiples of the fundamental, which correspond 
mathematically to succeeding terms of a Fourier series), and the tester 
must know how to determine their presence and their intensities. The 
airplane designer must similarly guard against possible harmonics of 
frequencies that are unavoidably present in engine operation. The 
tester again must know how to detect their presence and to measure 
their intensities. In telephony, radio, and sound projection, distortions 
due to emphasizing or minimizing harmonics need to be reduced. In 
musical instruments, the harmonics introduced and properly controlled 
determine the quality of the instrument. In all the cases named, experi- 
mentally observed or recorded effects for a definite angle swept out, for 
a definite distance traversed, or for a definite period of time, are the 
bases for design, correction, or control. ^ 

2. Functions Expressible by Fourier Series. Most of the functions 
which the experimental worker desires to expand into Fourier series 
involve angular displacement, time, or distance as the independent vari- 
able. Other physical quantities, of course, may be and are similarly 
involved. The dependent variables concerned are much more numerous. 
Of - the many combinations, we may mention three of importance to 
industry: those concerned with (1) the graph of the electrical engineer 
showing instantaneous emf's or other electrical quantities for an AC 
generator, transformer, or circuit as a function of the phase angle, (2) 
the graphs of the builder of musical instruments showing the displace- 
ments of some portion of a string from its normal position as a function 
of time, and (3) the graphs of the vibration specialist showing displace- 
ments of the various parts of a structure in vibration as a function of 
position. ' 

Corresponding to these three groups of particular interest with inde- 
pendent variables represented in order by 6, tj and we shall develop 
Fourier series of the types, 

y = f{d), iovO <6 <2t [ 2 ] 

V=f(^ty=Fi(t),foT0<t<T [3] 

2 / =/^Y^) “ '^ 2 ( 2 :), for 0 < a: < X [4] 

in “which T represents the period of a simple harmonic motion and X a 
wavelength. In all three equations, the quantities in parentheses, repre- 
sent angles, a necessary condition, since the series are trigonometriCc 
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Often, as suggested by Eqs. 2 to 4, the functions to be developed 
into Fourier series are cyclical. When graphed, inspection shows that 
a certain portion by successive repetition forms the whole. The mini- 
mum such portion forms a cycle. 

Illustrating such cyclical varia- 
tions, Fig. 1 shows the supplied 
potential difference, the current, 
and the instantaneous power for a 
particular capacitative circuit as 
a function of time. Harmonic fre- 
quencies which are multiples of the 
fundamental AC frequency are 
quite evident. 

Frequently in theoretical physics 
we are concerned with a distribu- 
tion of some quantity with distance 
in which there is no cyclical repe- 



tition for the function / 




Fig. 1. Oscillograms showing suppKed 
potential difference, current, and in- 
stantaneous power for a particular 
capacitative circuit. (Kerchner, R. H.y 
and Cor coran f G, F., Alternating Cir- 
cuits^ p. 129, John Wiley & Sons, Inc., 
New York, 1938.) 


although the function itself extends 
to infinity. In this case, a Fourier 
series may be used, in which in effect X becomes infinite. The form of 
the series is modified, however, to become a double integral known as 
Fourier’s integral. This will be discussed later. 



Fig. 2. Graph of a function given by y = 0.50 for the range 0 < 0 < x and by 
2/ == — x/4 for the range tt < $ < 2x. 

The limitations as to form for a function of a single independent vari- 
able which may be expressed as a Fourier series, are surprisingly few. 
In fact, so long as a function is real, finite, single valued for the inde- 
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pendent variable and possesses only a finite number of finite discontinue 
ities, a series may be found to i:epresent it. One part of a cycle, if cycles 
are present, may have no apparent relation to another part. Illustrate 
ing this feature, Fig. 2 shows a graph for which we shall develop a series 
later. 

3, Types of Fourier Series. The most common type of Fourier series 
is that represented by Eq. 1. It is known as a whole range sine-cosine 
series. However, for many purposes, it is desirable to have a different 
form of series in which the series of cosine and sine terms of Eq. 1 in 
pairs are combined to yield a series containing sine or cosine terms only. 
Doing so involves introducing phase angles in accord with the following 
equation. 

am sin md + hm cos md = Om^ + hm^ sin \mB-\- tan"“^ " 

\ CLm 

^ V aj^ + brn^ cos (md - tan"”^ ^ \ [5] 

Verification of Eq. 5 follows at once when its right-hand members are 
expanded in terms of sines and cosines of md and tan“"^ (fim/dm)- Eq. 1 
may be rewritten as 

= f(0) = 4“ ^ ^ Am sin (md + €m) 


of which 
and 


Eq. 6, in all respects the equivalent of Eq. 1, has an advantage over 
Eq. 1 in that it shows directly the phase relations for the various fre- 
quencies, which, though present in the form of Eq. 1, are not so evident. 
In the form of Eq. 6, each term separately, rather than by pairs as in 
Eq. 1, represents the whole contribution of a given frequency or har- 
monic. To distinguish harmonics from one another, each is given a 
number corresponding to its m. Thus for m = 1 we have the first har- 
monic or fundamental. Corresponding to m = 2, 3, 4, etc., we likewise 
have the second, the third, the fourth harmonics, etc. 
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Making use of the well-known relations 


and 


cos md = 


2 


^imd g — imQ 

sin mB = — 

2 % 


Eq. 1 may also be expressed as 


[ 9 ] 

[ 10 ] 


2/ = /(e) = I + ^ ^ [(&™ - ichnY'”^ + {hr. + [11] 

m = l 

The coeflScients of 6^"”^ and are conjugate, a characteristic often 
permitting considerable simplification of computations. Eq. 11 is much 
used. 

In addition to the whole range sine-cosine series, there is a half-range 
sine series 

00 

y = /i(e) = ^2 sin [12] 

m= 1 

and a half-range cosine series 

» 

y = f2{6) = ^ + ^2 

m=l 

A sine series, as is more or less evident, yields a graph (Fig. ZA) which 
is sjnnmetrical with respect to the origin or to points on the ^-axis where 



kA) (R) 

Fig. 3. (A). Graph of a sine series. (B). Graph of a cosine series. For the range 
0 < 0 < TT, the graphs are alike. 

e = inx. Similarly the half-range cosine series yields a graph (Fig. 
ZB) which is symmetrical with respect to lines perpendicular to the 
^-axis at these same points. These series will be discussed more fully 
later. 
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Lastly we refer again to Fourier's integral, a limiting form for a 
Fourier whole range sine-cosine series when the range of the cycle is 
infinite in extent. We shall discuss it later. 

In what precedes, it has been tacitly assumed that the origin of co- 
ordinates for a problem has been somehow fixed and that the series has 
been developed accordingly. It is always possible, however, for the 
operator to select what shall be the beginning and the ending of a range, 
^^en the function is cyclical, certain points will appear more natural 
than others for such choices. If, for instance, there are two loops to 
the graph of a cycle, one positive and the other negative, and both are 
of equal length, a point of intersection of two succeeding loops with the 
^-axis may be chosen as the origin. Instead, however, a point midway 
between two such successive intersections will sometimes be chosen. 
Which choice is to be made will depend to some extent on the type of 
series desired and that will usually depend upon other considerations. 

4. Some General Considerations. That Fourier series will converge 
has been shown. The proof, which is said by Byerly ^ to be ^^elaborate,” 
is assumed and accepted here. 

Connected with this feature of convergence are the questions of inte- 
grability and differentiability. Granting convergence, it is easily seen 
that a Fourier series may always be integrated though not always differ- 
entiated. To illustrate, the integral of f{6) dd^ as expressed in Eq. 1 , 
when integrated term by term, yields 

f f(0) dd.^ ai (1 — cos “h 7 “ (1 — cos 2B) + 7 ~ (1 “ cos Zd) -)-••• 

Jq 2 3 

+ ^ ^ Bme + ~ sin 26 + ^ sin3i9 -f- - • • [14] 

2 2 3 

while the derivative is given by 
d 

“/( 0 ) = ai cos 6 + 2 a 2 cos 26 + Zaz cos 3^ H 

— [ 6 i sin 6 + 262 sin 26 + 863 sin H ] [15] 

Granted that the coefficients of Eq. 1 form a converging series, it is 
evident that those of Eq. 14 will also converge, since term by term, in 
comparison with those of Eq. 1 , the coefficients of Eq, 14 are progres- 
sively smaller. At the same time the coefficients of Eq. 15 term by term 
are progressively greater. While convergence is always assured for the 
integral, it is not so assured for the derivative. 

^Byerly, W. E,, Fourier’s Series and Spherical Harmonics^ Ginn <fe Company, 
1893, p. 38, 
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Two questions may be properly asked at this point. (1) Is it prob- 
able that a smooth curve, for example one of those shown in Fig. 1, 
can be represented faithfully by a sine-cosine series, or is it just an 
approximation? (2) For a graph of the type shown in Fig. 2, what 
value or values doesf(x) possess at ^ = tt (strictly tt radians)? Reply- 
ing to the first question, the answer is that an equation with an infinite 
number of arbitrary constants can be made to yield a locus which passes 
through an infinite number of chosen points. Viewing a series as such 
an equation and the line of a graph as the aggregate of such a selection 
of points, the probability seems reasonable. Further, tests with actual 
series seem to indicate no exception to the possibility. As to question 
(2), the answer is that the computed value of f{6) iovd = t for the func- 
tion graphed in Fig. 2 is represented by a point midway between the 
line y = 0.50 at 0 = x and the line y = — 7r/4. The exact value is 
+7r/8. 

6. The Coefficients of the Whole Range Sine-Cosine Series for/(9). 
The well-recognized procedure for determining the coefficients of Eq. 1 
follows. (1) Multiply both sides of Eq. 1 by the sine or cosine factor 
of a selected term on the right. (2) Integrate both sides of the equation 
obtained with respect to 6 between the limits 0 and 2t (strictly 27r 
radians). (3) Evaluate the coefficient of the term whose sine or cosine 
factor was chosen for the first step. To illustrate, we shall evaluate 
5o> and bmy of which m represents any other subscript than zero. 
Steps one and two yield 


y^27r y^27r 

I /(0)sinm0d0= / ai sin 0 sin m0 d0+ / a 2 Sin 20 sinm 0 d 0 +* 
•/o Jq 


'0 ^0 
'* 2 t 

-h / am sin^ mB dd-” + 


■£ 

■£ 


Jo 2 


>0 

sin m0 d$ 


+ / 6i cos 0 sin w0 d0 • 


[16] 


— TT dm 

Step three leads at once to 


= i A 

TT Jo 


/(0) sin mJ9 dB 


[17] 


/-27r 

Except for the term / sin^ m0 d0, all terms on the right of Eq. 16 

Jo 

separately equate to zero, That this is true can be shown rather simply 
either mathematically or physically. 
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Similar procedure for bo, understanding that the trigonometric factor 
multiplying it in the series is 1, leads to 

/'27r ^2rr /-Stt t 

' fiS) dd — I ai sin d dO + I a 2 sm 2 ddd-\ h / 

0 0 ^ 0 •J ^ 

' 6i cos 0 H [18] 

0 


■dB 


= ir6o 


6o 


1 

- / 

IT Jq 


In like maimer may be evaluated, and we obtain 


ir^O 


/(S) COS mB dd 


[19] 


[20] 


Eq. 20 evidently includes Eq. 19 as a special case. With m equal to 
2 ero cos mS becomes 1. 

With recourse to tabular or graphical integration if necessary, it now 
becomes possible to determine the coefficients of the series of Eq. 1 
.when/(^) is expressed either in equation form or graphically as in Fig. 1. 
The process may or may not be tedious, depending largely on the num- 
ber of terms that must be used to obtain the desired accuracy. For- 
tunately, a series often converges so rapidly that only a few terms need 
be evaluated. 

6. Evalttation of the Coefficients for a Particular Whole Range Sine- 
Cosine Series* To illustrate the procedure, we shall make use of the 
function graphed in Fig. 2. Its value is given by f{d) = 6/2 for the 
range 0 < ^ < tt and/(i9) = "-'7r/4 for tt < 0 < 2r, There is a discon- 
tinuity at 0 = X. Eqs. 17, 19, and 20, applied directly, yield 


Urn = 

L mi 


sin md do + 


r 


sin m6 dB 


\m odd 


1 “ 

0>m — cx 

L 2mJ» 


[ 21 ] 

[ 22 ] 

[23] 


1 As stated above, some authors use 6o not 6o/2 as the constant term of Eq. 1. 
For them the value of Z>o is just that given by Eq. 19. Using 6o/2 for the first term 
has the advantage that, when so used, the general equation for the various 
applies to ho also. 
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5 “®+/ X'®]"" 


cos 


hjn, — 


M Tjm odd 


\Pm — 0]w 


y = = sin i 


sin 2^ + ^ sin SO — - — sin 4:6 + 
2X2 3 2X4 


1 r 1 

cos ^ 

T L O 


2 COS 3^ "t~ cos 5V “f" 


-] 

■■■] 


Checking shows the following relation between 6 and the computed f(6) 
^ ^ T T Stt 5 t 3 t 7 ^ ^ 

^ 0 T;;"r^-rir“r2x 

4 2 4 4 2 4 

. . — TT TT TT StT TT — T — T — TT 

~s~ 8 4 y 8 ~r ^ y s 


As expected, f(6) for ^ equal to 0, w, and 2t is the mean of the values 
predicted separately by the two lines of the graph. 

7. The Half-Range Series for/(6). If one is interested in the values 
for f(6) only for the range 0 < ^ < x or if the portion for the range 
X < ^ < 2x is symmetrical in either of two ways with the portion for 
the range 0 < 0 < x, one has the possibility of developing the function 
for one or the other of two half-range series, a sine series corresponding 
to the a terms of Eq. 1 and a cosine series corresponding to the b terms. 
Generally such half-range sine or cosine series are preferred to whole- 
range series since they involve less labor. Moreover, through contain- 
ing terms of one type only, they make it possible in certain computations 
to comply with certain boundary conditions when otherwise it would 
be impossible. 

If the graph of the whole range is symmetrical with respect to a point 
on the 0-axis at 0 = 0, x, 2x, etc., that is, if the function is odd, as in 
Fig. 3 A, the series can evidently contain only sine terms. The term 
am sin m0, whatever the value of m, will have values of opposite signs 
though of the same magnitude when successively x — 5 and x + S are 
substituted for 0, while, for the term bm cos mO, the corresponding values 
will be both of the same sign and the same magnitude. Obviously, on 
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the other hand, if the graph of the whole range is symmetrical with 
respect to the perpendicular to the ^-axis at ^ = 0, tt, 27 r, etc., that is, 
if the function is even, as in Fig. 3i5, the series can contain cosihe terms 
only. 

Comparing A and B of Fig. 3, we see that they are identical in the 
portions in the ranges 0 < 0 < t, though not generally elsewhere. It 
appears, and is the case, that a given line in the range 0 < 0 < tt may 
therefore be represented by either a sine or a cosine series and also any 
number of combinations of part sine and part cosine series. Outside 
the stated range, however, all will differ. 

In developing a haif-range series, the procedure for determining the 
coeiEcients is the same as that for the whole-range series. Assuming thus 

y = f^(e) = ai sin 6 + a 2 sin 20 -f as sin 30 H [29] 


multiplying through by sin m0, integrating with respect to 0 between 
the limits 0 and x (not 2x as for the whole range), and evaluating, one 
obtains 



2 f"" 

oLm = - 1 /i(0) sin md dd 

. [30] 

T Jo 

Similarly for the hajf-range cosine series, assuming 

II 

= ^ + jSi cos 0 + /32 cos 29 + jSa cos 3^ H 

A 

[31] 

we obtain 

1 

11 

o 

1 

[32] 

and 

TT ^0 

2 A 

Pm - - 1 f2(0) cosmedd 

TT Jo 

1 1 — 1 

CO 
CO, 


Eqs. 30, 32, and 33 differ from Eqs. 17, 19, and 20 in that the constants 
preceding the integrals are twice as great and in that the upper limits 
of the integrals are one-half as great. It is of interest to note that, by 
change of the independent variable from 0 to 0 where 4> = 0/2, it is 
possible to obtain a normal half-range series for the new variable 
which is equivalent to the whole-range for 0. Referring to Fig. 2, for 
instance, the range 0 < <^> < x would cover the whole range in 0, namely 
0 < 0 < 2x. Further, the appropriate half-range series in 4> in terms 
of cosines, say, once developed, can be converted by substitution into ' 
a cosine series in 6 with the Pi term containing the angle 0/2. The func- ' 
tion for the whole range, as initially described, is now described by a 
cosine series. 
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8. Evaluation of the Coefficients for Particular Half-Range Sine and 
Cosine Series. Consider a sine series to represent, between the limits 
0 and TT, the straight line whose equation is 

[34] 

Substitution in Eq. 30 yields 

^ r ^ 1 

= ~ I -sinmS ad — zk — [35] 

IT Jq 2 m 

with the sign positive when m is odd and negative when even. We have 
therefore 

y = /i(^) = sin ^ — I sin 20 + ^ sin 30 — sin 4^ d [36] 

For the cosine series representing the same straight line in the range 
0 < 0 < TT, we obtain 



2 0 

/5m = - / - cos md dd [38] 

TT Jq 2 


When m is odd, has the value — (2/mV); when m is even, its value 
is zero. There follows 

2/ = /2 (^) ~ ^ ~ ^ V ^ cos 30 + ^ cos 50 + • • • ^ [39] 

By trial both Eq. 36 and Eq. 39 are found to check. The process is 
simple for the latter at points where 0 takes the values 0, x/4, t/ 2, 
37r/4, Tj though, for both end values, one is helped by recognizing that 

l+| + |+f2+--- = Y t40] 


No trouble is experienced in checking Eq. 36 for similar values of 0, 
though one is helped at x/2 by recognizing that 



[41] 


At 0 = X because of the discontinuity in /i(0) at this point, the value of 
the function is midway between +x/2 and — x/2. This value is not 
approached as a limit. However, both Eq. 36 and Eq. 39 describe the 
same curve between 0 = 0 and 0 = x, though in the region outside they 



Fig. 4. Showing in downward progression the separate contributions of the s accessive 
terras of Eq. 36 (sine series) at the left and Eq. 39 (cosine series) at the right, and 
the successive approximations to the straight line y = 0/2 in the range 0 < 0 < x. 

Each new terra is represented by and the approximation to the straight line 

produced by its inclusion by — 
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differ greatly. It is interesting to note the separate contributions of the 
succeeding terms of Eqs. 36 and 39 as sho'^m in Fig. 4. It is very appar- 
ent that the cosine series converges the more rapidly. 


9. Series Representing y 




It is well to 


repeat that here T represents the period of a simple harmonic motion, 
that of the fundamental of a vibrating system, and that X is a wave- 
length, that of the fundamental of a wave motion. The forms of the 
whole-range and half-range series are like those for y =f(d). Their 
coefficients may be obtained by procedures exactly like those used in 
obtaining corresponding values for f(d). Thus, for the whole-range sine- 
cosine series, we have 


+ b'mOOs(m~ty^ [42] 
a» = I jT sin ("» y ii) dt [43] 

2 /27r\ 

&'o = yjf [43a] 

2 / 2t \ (2'ir\ 

For the half-range sine series, we have 

2/ = /i ( Y V 

, 4 /2t \ / 2x \ , 

For the half-range cosine series, we have 

2/ = /a i) = Y + 2 ^ “ cos (m ^ 


[45] 

[46] 

[47] 
[47a] 

[48] 


An analogous equation involving / 




is obtained by substituting 
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X and X for t and T of Eq. 42, and the equations for coefficients 1"^, 
a"m, and /S'to for the (a:,X) series are exactly like Eqs. 42 to 48. 

27r 27r 

If in Eqs. 17, 19, and 20, one replaces ^ by — ^ and — he obtains 

i A 

for bo, and 6,^, identically the expressions for the primed and the 
double primed constants of Eqs. 42 to 48. This indicates that a^i, 
and a^'^, for instance, are the same quantity arising in different connec- 
tions. That in these expressions we have 2/T and 2/X where before we 
had I/tt is a consequence of the fact that the cycles for the independent 
variables here end when the values T and \ are reached whereas in the 
preceding case it ended when 27r not tt was reached. Some authors 
use 0 < t < 2T and 0 < x < 2\ for ranges. In that case the constants 
preceding the integrals of Eqs. 42 to 48 are reduced to 1/T, 1/X, etc. 

10. The Limiting Series for the Range 0 < x < oo and Fourier^s 
Integral. With the understanding that X of the series 




^ \^ani sin Y cos {m ^ 


will be allowed later to increase indefinitely, recognizing that X will then 
no longer represent a wavelength, let us replace it by Z. We then have 


in which 


Fix) = ~ + ^ sin + bm cos (^m y [50] 

471 — 1 

ll 

2 f’’ {2 t\ 

= j J E(x) sin yn — x j dx [51] 




Fix) dx 




Substitution in Eq. 50 yields 


E(a:) = y f Fix)dx + 


+ cos 


2 r - Y ^ Cr?! \ ■ I ^ J 

J / ^ l^sm yn ~Y^JJ — xjdx 

- cos ijn ^ x^ J" F(x) cos (m ^ dx^ [53] 
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Since definite integrals are functions of their limits, we may, in order to 
avoid confusion, replace the symbol x where found within such an inte- 
gral by some other symbol, say /z. Then we may write 


^(m) dfjL + j F(/x) sin 

+ F(jx) cos ^ cos (^m y cZp j [54] 


Inspection shows the possibility of replacing a combination of terms 

. f 27r \ / Stt \ / 2t \ / 2x \ 

such as cos — fij gos I m — rr J + sm ( m — jjl) sm I m — xj by 


cos 


27r 

m — (jLt 


j KT-- X)\‘ 


Hence we write 


'pin) + £f(h) cos 


I 


dix [55] 


Let the summation be now changed so as to extend from m = — oo to 
m = -f-oo . . Since the cosines for negative m^s are equal to corresponding 
ones for positive m’s, no trouble is experienced. At the same time, the 


multiplier of the summation changes to 1/1 and the 
now fits into the summation, and we have 


-r 

I Jo 


F(fi) dn 


F(x)=j f 2 

m = — oo L 

m = ^ w 


27r ■ 

m—(fi-x) 


I 


27r 


[56J 


If now I is increased without limit and m2'K/l is treated as a new 
variable, v say, with its differential dv equal to 27r/Z, Eq. 56 may be 
rewritten as follows: 


ri?(a:) = L y d,x f cos v(fi. - x) dv\ [57] 

L 2t Jq J—aci Jo<a;<« 

Though no change in value for the integral occurs when the order of 
integration is reversed, such reversal is found convenient and necessary 
in application. Thus reversed Eq. 57 becomes 
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Had we followed the procedure of certain other authors and developed 
series for the ranges —tt < d < t, —T/2 < t < T, ~X/2 < x < X/2, 
instead of 0 < ^ < 27r, 0 < < T, 0 < x < X, the relation obtained in 

place of Eq. 58 would have satisfied the range — co < 0 < oo. Its 
forna, slightly different, is the following: 

<j)(x) — - I dv I cj)(fjL) COS v(}x — x) d/jL [59] 

The right-hand member of Eq. 59 is known as Fourier’s integral. It is 
more inclusive than Eq. 58, which it includes as a special case. In 
making the transfer from one form to another, however, one needs to 
note that the portion- of a function which is expanded in the range 
0 < X < Z to yield Eq. 58 is different from that which is expanded in 
the range —1/2 < x < Z/2, and that therefore the F(x) of Eq. 58 is not 
the 0(x) of Eq. 59. 

Eqs. 58 and 59 are found indispensable in the solution of many prob- 
lems of theoretical and practical physics, involving electricity, magnet- 
ism, heat flow, x-ray analysis, etc. To illustrate its use here seems out- 
side the scope of the present work and will not be done. 

11. Special Cycles Consisting of a Positive and a Negative Loop. 
The graphs of many functions met with in practice show cycles consist- 
ing of a positive and a negative loop, both of the same extent along the 
independent variable axis. Because of certain characteristics, many of 
these permit of simplified treatment. Four cases will be discussed. 

Case I. The Area of the Positive Loop Equal to That of the Negative 
Loop. In this case the term of the whole range sine-cosine series involv- 

/ 27r 

f{d) do 

represents the area enclosed between the loops and the ^-axis; and, if 
this area is nil, the coefficient is likewise zero. The loops need not be 
of equal lengths in this instance. 

Case II. Positive Loop Asymmetric; Negative Loop a Displaced Image 
of the Positive Loop. An illustration is given in Fig. 5 at A . It is a cycle 
that is encountered frequently in electrical engineering. Evidently 6o 
is zero. For the further evaluation of coefficients, we have the condition 
that /(^ + tt) shall equal —f(d). This is met by both sine and cosine 
terms when only odd values of m are used since 


[sin me = -sin m(d + x)]^ odd 
[cos md = -cosm(0 + x)]„, odd 


[60] 

[61] 
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Even values of m do not yield the change of sign. The type of series 
that satisfies Fig. 5ri is therefore the whole range sine-cosine series 
containing odd terms only^, thus 

y = /(^) = ai sin ^ + as sin 30 + as sin 5^ d 

+ hi cos 0 + 63 cos 30 d [62] 

In obtaining values for the coefficients it is evidently not^ necessary to 
integrate over more than one loop. In each instance the integral for 
the whole range will be just twice that for one loop. 



Fig. 


(^) (B) CO 

5. Three special cycles with graphs composed of a single positive and a single 
negative loop of equal extent along the axis of the independent variable. 


Case III, Positive Loop Asymmetric] Negative Loop Possesses Point 
Symmetry with Respect to the Positive Loop. An illustration is given in 
Fig. bB, This type of wave may be met in various fields, in particular 
in sonics. The function is odd. An evident condition which must be 
fulfilled by the series is that /(tt — A) shall equal —/(tt -f* A). This is 
fulfilled by all sine terms whether m is odd or even. All cosine terms 
fail. Thus 

sin (mTT — A) = —sin (ttit d- A) [63] 

while 

cos (mx — A) = cos (mx -f A) [64] 

It follows that Fig. bB vdll be described satisfactorily by a regular 
half-range sine series. 

Case IV. Positive Loop Symmetrical; Negative Loop Possesses Point 
Symmetry with Respect to the Positive Loop. An illustration is given in 
Fig. bC. This cycle occurs frequently. Obviously in this case, as in 
case III, the function is odd and a half-range sine series suffices. There 
is an added condition, however. Here /(t/ 2 d- A) equals /(x/2 — A). 
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This condition is fulfilled by sine terms only when m is odd. The series 
then takes the form 

y = f(Q) = ai sin d + as sin 3^ + as sin 5^ d [65] 

While integrating to obtain values for the coefl&cients, one needs only 
to integrate over one-half of the first loop. Because of symmetry the 
integral for the whole loop is twice that for the half. 

In this case, were a shift of the origin made to the middle of a loop, the 
series required would be a half-range cosine series with odd terms only 
present. The even terms are eliminated by the condition of point sym- 
metry demanded for 0 ' = t/2 in the shifted coordinate system. 

12. Tabular Integration Method of Obtaining Series Coefficients. 
As the function to be used in illustrating a procedure suitable for such 
determinations, we make use of an oscillogram ^ (Fig. 6 ) which is rather 
similar to the instantaneous power oscillogram of Fig. 1 . The cycle in- 
volved is of the type described under case II of the preceding section. 
Our task is that of determining coefficients ai, as, as, • • • bi, 63 , 65 , • • •. 
Kerchner and Corcoran in the reference cited give values for the in- 
stantaneous current at 5® intervals between 0 ° and 180° beginning at 
0°. To these we shall apply Eqs. 17, 19, and 20, using a tabular trape- 
zoidal method of integration as described in Chapter IV, rather than 
the slightly different procedure used by the authors. How it is carried 
out is shown in Table I, where values have been determined for ai, 61 , 
as, and 63 . Similar procedure will yield values for the a^s and Vs of 
higher harmonics. As tabulated, one sees that the same numeric occurs 
frequently as a sine or a cosine factor. If a slide rule or computing 
machine is used in making calculations, much time may be saved by 
setting the rule or computing machine so that successive multiplications 
involving such a numeric can be carried through conveniently. 

Collected values for the desired series are given in Table II. Because 
of the slightly different procedure mentioned, the constants for the funda- 
mental or first harmonic and for the third harmonic differ slightly from 
those obtained by Kerchner and Corcoran. Values for the fifth and the 
seventh harmonics, however, are those which they obtained. 

In evaluating the €t^i^s for a series of the form of Eq. 6 , one must choose, 
in each case, between two supplementary angles with the same value of 
tan €ni.' Which angle to take depends on the signs of the coefficients 
a^ and hm- Referring to Eqs. 7 and 8 , it is seen that they may be solved 
simultaneously for a,^ and in terms of Am and €m to yield am = Am 
cos €m and bm = Am sin ^m- With Ami defined by Eq. 7, taken as 

^ Kerchner, R. M., and Corcoran, G. F., op. cit., p.l39. 
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essentially positive, it follows that cos has the same sign as and 
that sin has the same sign as bm- With this understanding, the ranges 
for various initial phase angles em that correspond to various combina- 
tions of positive and negative signs for and b^ are those shown in 



phase Angle 


Fig. 6. An oscillogram showing instantaneous current as a function of phase angle 
for one-half of a cycle. The area between the trace and the phase angle axis ha^ 
been subdivided into 36 portions by vertical lines drawn at 5 degree intervals. 
(Kerchner, R. H., and Corcoran, G. F., AlterTiatiTig CurrentSy p. 139, New York. 
John Wiley and Sons, Inc., 1938.) 

Table III. These relations are also shown graphically in Fig. 7 where 
dm B.nd hm are treated as x and y components of a vector. As is evident, 
a positive em for the range < em < 2t may be treated as a negative 
€m with a corresponding value between 0 and t. 

As a result of the analysis summarized in Table II, and the interpre- 
tations of Table III and Fig. 7, we may now write the series to and in- 
cluding the 7th harmonic in the two following equivalent forms, from 
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which the names of the units accompanying the constants have been 
omitted. 

y = 82.3 sin 0-22.1 cos 6 - 0,90 sin + 26.0 cos 30 

. - 5.38 sin 50 - 3.65 cos 50 + 2.01 sin 70 - 1.29 cos 70 [66] 
2 / = 85.1 sin (0 - 15.1°) + 26.0 sin (30 + 92°) 

+ 6.3 sin (50 - 146°) + 2.4 sin (70 - 33°) [67] 

TABLE II 

Collected Values pob the Constants of Sekies of the Type op Eqs. 1 and 6 
TO Repkesent the Instantaneous Current Oscillogram of Pig. 6, Data for 
Which, Taken from Measurements by Kerchner and Corcoran,^ Are Given 

IN Table I 


Values for the fifth and seventh harmonics are those which they computed. Units 
for Om, hmj and Vum^ + are arbitrary. 


Con- 

Har-\stant 

monic 

dm 

bm 

Am or 

bm 

— or 
dm 

tan ^m 

Quadrant 
for a 
Positive 

tan 

dm 

or 


Fundamental 

82.3 

-22.1 

85.1 

- 0.269 

4th 

- 15. r 

3rd 

- 0.90 

26.0 

26.0 i 

-28.9 

2nd 

+ 92.0° 

5th 

~ 5.38 

~ 3.65 

6.3 

4- 0.679 

3rd 

-145.9° 

7th 

2.01 

- 1.29 

2.4 

- 0.640 

4th 

- 32.6° 


TABLE III 

Showing Connection Between the Signs op and hm of the Whole Range 
Sine-Cosine Series of Eq. 1 and the Range of the Corresponding € m , Con- 
sidered Positive, of Eq. 6 When the Series Is Shifted to That Form 

Sign of am Sign of bm Range of em 

+ + (> < 

TT 

— + 2 ^ 

Stt 

• Stt 

+ — “T < < 27r 


1 Op. cit. 
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Inspection of Eq. 67 shows that the contribution of each harmonic 
has decreased with the increase in its order. It is probable that the con- 
tributions of the harmonies of stiU higher orders are negligible but such 
is not certain without further tests, one of which consists in finding the 
differences between the measured y’s and the computed using Eq. 
66 or Eq. 67. 

With regard to accuracy, it is easily seen that as the order of the har- 
monic increases, the uncertainty with respect to the magnitudes of the 



Fundamental Third Harmonic 


Fig. 7. Showing a vector graph useful in determining the range of cm of Eq. 6 and 
hence in determining a phase angle when its tangent is known. The graphs repre- 
sent conditions for the fundamental and the third harmonic shown in Table II. 

amplitudes also increases. Referring to the computations for the first 
and third harmonics as shown in Table I, it is seen that the range of 6 
for which a given y is assumed to be an average is three times as great 
for the third as for the first harmonic. For a higher harmonic the range 
is correspondingly greater, with an uncertainty that is also correspond- 
ingly greater. 

Certain time-saving, tabular methods ^ have been developed for the 
determination of the coefficients of a Fourier series. Reference to such 
shortened methods is recommended for one who is limited by circum- 
stances to the tabular method and has several determinations ahead of 
him. 

^Lipka, Joseph, GrapAicuZ and Mechanical Compatationj Chap. VH, New York, 
John Wiley & Sons, Inc., 1918. ' 

Running, T. R., Empirical FormulaSy p. 74, New York, John Wiley Sons, 1917. 

H. O. Taylor, Phys. Rev., 6, 303 (1915). 
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13, The Rolling Sphere Harmonic Analyzer. The discussion here is 
based on a description of the construction and operation of an Henrici ^ 
analyzer by D. C. Miller.^ In theory it is a device for the mechanical 
determinations of areas corresponding to the various integrals 


1 

dni — 



/ f{d) sin mddd 

[17] 

^ , 

Jo 

1 



K = - 

/. /(d) cos mB do 

[20] 


/o 


Obviously, given a certain /(0) (Fig. 8A), it is possible to plot various 
curves (Fig. 8C) corresponding to the various integrands described by 



Fig. 8. Graphs illustrating graphical harmonic analysis, using ordinary planimeters. 
A, Graph of function; B, graph of sine factor of the third harmonic; C, graph of 
fid) sin 3^ as a function of 


Eqs. 17 and 20 and then to determine areas with the aid of an ordinary 
planimeter. Such curve plotting, one for each coefficient, would be very 
time consuming, and a machine to be of value must eliminate much of 
such procedure. This the Henrici instrument does. 

Integration of the right-hand terms of Eqs. 17 and 20 by the ' ‘inte- 
gration-by-parts' ^ method, replacing /(0) by y, yields 

^Hennci, 0., Afagr., 38, 110 (1894). 

2 Miller, D. C., /. Franklin Inst, 182, 285 (1916). 
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and 


= 




^ -|27r ^d=2Tr 

y COS mB H / cos wB dy 

mTT Jo rmr J 8^0 

“ 1 -i2tc ^6=2t 

— ^ sin — — / sin tttB dy 

-rmr Jo mir J 8=0 


[6S] 

[69] 


The first member on the right of Eq. 69 is obviously equal to zero. If 
now, as conditions precedent to the use of the Henrici instrument, con- 
ditions are so determined that 


[y = /W = 0]e^o 

6 = 2r 


[70] 


the first member on the right of Eq. 68 also becomes zero. 
69 then become 


and 


dm 


M=2t 

= — / COS ttiB dy 

lUT J 8= 


6=0 


p6=2r 

= — . — / sin da/ 
micJ 8 = 


6=0 


Eqs. 68 and 


[71] 

[72] 


These are the basic equations governing the construction of Henrici^s 
instrument. Interestingly the sine coefficients now contain a -cosine 
integral and vice versa. 



Fig. 9. Photograph of an Henriei harmonic analyzer with a curve in position to be 
analyzed. {Miller, D. C., J. Franklin Inst, 182, 285, 1916.) 


Fig. 9 shows a photograph of a completed instrument with a curve 
to be analyzed in position. This curve must be plotted so that a certain 
linear distance, s to h in the figure, shall represent the angle 2^ radians. 
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If there are discontinuities, lines perpendicular to the 0-axis are drawn 
to connect the branches at the point of discontinuity. In operation this 
curve is traced by the stylus shown with its point at s. During the 
tracing, the wheels n, r^, rz roll backward and forward, carrying the 
superstructure. Two of these wheels r\ and rz have a common axle 
shaft that carries five other wheels which, however, do not touch the 
paper on which the graph has been plotted. Each of these five wheels, 
of which two are shown in Fig. 10, supports a glass sphere which is 



Fig. 10. Photograph of a portion of an Henrici harmonic analyzer showing relation 
of rolling spheres to the adjacent integrators. {Miller j D. C., Idem,) 

rotated by it. Their rotation d4> about an axis (the < 5 i>“axis) parallel to 
the line sh of the graph of Fig. 9 corresponding to a change dy on the 
graph is strictly proportional to dy. Obviously in accord with Eqs. 71 
and 72, it is still necessary to multiply each dy by its appropriate cos md 
or sin md and to sum up such products. For this purpose, as shown in 
Fig. 10 and in plan in Fig. 11, two rolling sphere integrators are kept 
in contact with each sphere. These integrators in contact with any one 
sphere are oriented at right angles to each other and contact the sphere 
at points separated by 90°. 

As the stylus (Fig. 9) is moved along the curve, a vertical shaft moves 
lengthwise of the superstructure and with it a wire is moved which passes 
around the pulleys at the tops of the frameworks about the glass spheres. 
The diameters of these pulleys vary as 1 : M • H and in size 

are such that, with the passage of the stylus from s to 6, they in turn 
make just 1, 2, 3, 4, and 5 rotations. With the stylus at s the frame- 
works about all of the spheres are set for the position mB = 0. Then, 
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with a slight movement of the stylus, there wUl be equal slight rotations 
d4> of all spheres about the < 5 &-axis proportional to the dy of the stylus 
motion. The integrators for the sine terms s wnl automatically weight 
this ^ according to cos 0"^ or unity in conformity with Eq. 71 and those 
for the cosine terms c will similarly weight the d(i> according to sin 0 ° or 
zero in conformity with Eq. 72. With further motion of the stylus, 
however, the frameworks carrying the integrators are shifted to gradu- 
ally varying orientations about the vertical axes through the spheres. 
The positions for md = 0*^ and md'= 30"^ are shown in Fig. 11. 



m^;=30“ 


Fig. 11 . Diagram showing the positions of the rolling sphere integrators in contact 
with the wth sphere for positions corresponding to mB = 2mr + 0° and mB — 2nr 
+ 30°. Integrator S yields the sine component, integrator C the cosine component, 
of the mth harmonic. 

As reflection will show, with the passage of the stylus from 5 to 6 
(Fig. 9), the framework about the mth sphere will make m complete 
rotations and the s and the c integrators will give indications propor- 
tional to am and bm as given in Eqs. 71 and 72. With dimensions prop- 
erly chosen proportionality factors, except for 1/m, may be made unity. 

In use, the changes in the integrator readings with shift of the stylus 
from 5 to h (Fig. 9) yield the first five sine and cosine coefficients, not 
ho, however. A set of the 6th to 10th coefficients, etc., can be obtained 
with the aid of other sets of pulleys at the tops of the frameworks carry- 
ing the integrators. In anticipation of such changes double puUeys are 
provided as showm in Fig. 10. Compound pulleys with larger diameters 
^4 and ds to yield 4 and 5 rotations per change of 2x in 0 have also smaller 
diameters d% and dio to yield 9 and 10 rotations for the same change in 0. 

Henrici^s instrument fails to yield a value for 5o/2. Ordinarily for 
cases treated with an analyzer, this term is of little significance. Should 
need be felt for obtaining it, one may use an ordinary planimeter to 
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determine the area between the curve and the base line containing 
the points a and b (Fig. 9) and then divide this area by 2'jr radians. 

By comparing the analyses of known mathematical functions obtained 
mathematically with those obtained by his Henrici analyzer, Miller 
demonstrated that the analyzer possessed ^^an inherent accuracy much 
greater than can be taken advantage of in graphic work.’’ lie stated 
that ^^The results are always accurate to a fraction of the width of the 
line representing the curve, and this precision is maintained uniformly 
for all the components, even to the thirtieth.” 

This judgment was based in part on the reconstructions of the original 
curves which were obtained with the aid of a harmonic synthesizer^ 
which he likewise described. 

Miller has also compared the speed with which results may be ob- 
tained, once data in the form of the required curve are given, with those 
for obtaining results by tabular methods presumably somewhat like 
that illustrated above. Of the results of three analyses of the same 
curve, the sound wave for an organ pipe, he states that the time required 
for the first ten harmonics by this method was 13 minutes, that the 
time required by the tabular method involving complete numerical re- 
duction from 36 ordinates was 10 hours, and that the time required by 
another tabular method with a prepared schedule which used only 18 
measured ordinates and yielded only 8 harmonics was 3 hours. Evi- 
dently, where much work is to be done in analyzing curves, a harmonic 
analyzer is a necessary instrument. 

14. Other Mechanical Analyzers. Without doubt analyzers of the 
Henrici type are among the best obtainable. Among purely mechanical 
instruments, they represent the best. As other instruments in common 
use, we have the common vibrating reed frequency indicator of elec- 
trical power stations, and the Chubb ^ polar analyzer (Fig. 12) which 
is found in electrical laboratories and power stations. The reed instru- 
ment requires a sustained repetition of the f{S) but no manual or other 
graphing of it. It can, however, only give indications of harmonics 
present and of their relative amplitudes. It cannot, at least as con- 
structed at present, show phase relations. The Chubb polar instrument 
requires a graph on polar paper, which is mounted in use on a circular 
gear-driven table. Each sine and cosine term requires a separate ad- 
justment of gears. There are. two motions, one of the table forward and 
back along a straight track, the other a rotation of the table with m 
cyclic trips on the straight track for each rotation. The tracer arm 
which moves only perpendicular to the straight track has the tracer 

^ Miller, D. O., J. Franklin Inst.j 181, 51 and 285 (1916). 

2 Chubb, L. W., Elec, /., 11, 91 (1914). 



NONMECHANICAL HARMONIC ANALYZERS 


135 


‘point of an ordinary polar planimeter inserted in a hole at one end. 
The area swept out by this tracer point during a cycle, in any particular 
instance, is proportional to the corresponding am or bm- From the series 
of values obtained, an analysis for f(d) similar to that represented in 
Eq.' 1 is obtained. 



Pig. 12. A diagram showing the principles of operation of the Chubb polar harmonic 

analyzer. 

15. Nonmechanical Harmonic Analyzers. Although the Henrici 
analyzer method saves much time in comparison with the straight 
tabular method, it is still time consuming. Other methods for specific 
purposes may be much superior through not requiring the plotting of a 
curve or by virtue of employing automatic integrating devices. Gener- 
ally, however, these improvements have been at the expense of precision 
in the analyses obtained. Where, as is often true, time and expense are 
important factors, some one of these methods may be more desirable. 

In a sense these methods are also mechanical because of the mechani- 
cal devices employed, but they are here classed as nonmechanical be- 
cause their important features depend upon photoelectric, electronic, 
electromagnetic, etc., effects. 

The basic theories for all analyzers start with Eqs. 17 and 20 and are 
necessarily much alike. It is necessary iu all instances to multiply in 
effect an f(d) by a cos md and by a sin mB where ordinarily a separate 
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operation must be performed for each value chosen for m and sometimes* 
for each cosine or sine multiplication. Further, phase relations must 
be controllable with precision. 

A simple harmonic analyzer dependent on photoelectric and elec- 
tronic effects was patented in 1933 by Marrison/ of the Bell Telephone 



Fig. 13. A diagram to show the principles of operation of the Marrison photoelectric 
harmonic analyzer for the case where only the amplitudes of the harmonics are to 
be determined. 


Laboratories. The main features of the method are shown in Pig. 13. 
The function f(6) is conveniently laid out in polar coordinates either by 
the appropriate blackening of a transparent circular plate disc or by 
cutting each disc to form a template as shown in Fig. 14. The dotted 
line is the axis of zero amplitude. Whichever way prepared, the f{d) 
disc is mounted on a motor whose speed of operation may be varied 

conveniently and precisely as desired. Thus 
mounted as shown at C in Fig. 13, it is 
rotated in the plane of the image of a line 
source of light A, formed by a simple 
convex lens, B. Back of this image plane, 
the light beam modified by the rotating 
f{d) enters a photoelectric cell, D, the out- 
put current of which passes to an amplifier, 
E. The output of E in turn passes to a 
filter, F, selective at a fixed frequency, and 
to a current meter, G, of the desired sensi- 
tivity. 

Let the characteristic frequency of the selective filter be arbitrarily 
fixed at 100 cycles/sec. In accord with this choice, the procedure for an 
harmonic analysis follows. The motor M is driven first at a speed of 
100 rps and the indication of meter G is read. Obviously, with all fre- 
quencies but 100 per second eliminated by F, the reading of G is a meas- 

^ Marrison, W. A., U. S. Patent 1,901,400. 



Fig. 14. An /(^) set up in 
polar coordinates for use 
with the Marrison har- 
monic analyzer. 
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lire of the amplitude of the first harmonic or fundamental of /(^). 
Next the speed of M is reduced to 50 rps and the indication of G is read 
once more. At this speed a component of f(6) whose frequency is 
twice that of the fxmdamental will be repeated 100 times per second in 
the output of the photoelectric cell D and will have its amplitude 
recorded at G. Similarly the amplitudes of succeeding harmonics may 
be obtained by operating the motor at speeds of 3^, 34? ®tc., of 

100 rps. Once jf(0) has been properly transferred to the motor-driven 
disc, the time required for the amplitude analysis is very brief. 



Fig. 15. A diagram to show the principles of operation of the Marrison photoelectric 
harmonic analyzer for the case where amplitudes and phase relations are both 
determined. 

Unfortunately the analysis just described gives no indications of phase 
relations. For this Marrison proposes, as shown in Fig. 16, the sub- 
stitution of an electrically driven tuning fork— with mirror I attached, 
a light beam /■, and a moving photographic film K to replace the filter 
F and the meter G shown in Fig. 13. Obviously a harmonic being 
analyzed will be shown drawn out as a sine curve with an amplitude 
proportional to that of the harmonic. For the phase determination, a 
straight-line trace on the same moving film is produced by light re- 
flected from a mirror which is stationary except for a small jog produced 
once each rotation of the motor by an appropriate contact mechanism. 
Fig. 16 is given by Marrison as the analysis of the f(6) of Fig. 14. Ob- 
viously the three components agree precisely in their phases for one 
particular value of 6 and differ in amplitudes. 

Another optical analyzer using photoelectric effects for its integra- 
tions has been constructed by Wente ^ and described by Montgomery.^ 
In the instrument described, the f (6) is represented by a variable area 
record or by a variable density record such as are found on photographic 

1 Wente, E. C., U. S. Patent No. 2,098,326. 

2 Montgomery, H- C., BeU System Tech. J., 17, 406 (1938). 
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films for sound reproduction, while the cos mS and the sin md factors 
are represented by similar records of the variable density type only. 
The/(0) record may vary from 1/16 inch to 5/16 inch in length and must 
not be higher than long. The sine and cosine factor records are about 
1 inch by 2 inches. In operation the /(0) and a cosine or a sine record 



Fig. 16. The graphical analysis of the f{d) of Fig. 14, 
according to Marrison. 


are mounted in an optical system (Fig. 17), and light from an incan- 
descent lamp is passed through to a collecting photoelectric cell whose 
response is an integrated product of the transmittances of the two rec- 
ords. By successive substitutions of the various sine and cosine records 
other corresponding photoelectric responses are obtained. Certain cor- 
rections must necessarily be taken into account. Although negative 


Photo* 



Fig. 17. A diagram showing the optical arrangements for an analysis using Wente’s 
optical harmonic analyzer. {Montgomery, H. C., Bell System Tech. J., 17 , 406, 
1938.) 

values for f(d), cos md and sin md will always occur, negative values for 
light flux are not possible. This difficulty is eliminated by combining 
the variable hght flux with a constant flux of appropriate magnitude, 
so that the hght flux may be positive at all points of passage through 
the system. Also 100% transmission as is indicated by sinwi^ for md 
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equal to 90° is an evident physical impossibility, and a modulating 
factor is necessary on this account. 

An analysis made with Wente’s instrument when compared with one 
made with an Henrici instrument showed certain discrepancies in magni- 
tude of amplitudes. (See Fig. 18, which shows comparative analysis of 
the sound /^ou’^ as in out.) On the basis of time of operation, however, 
this method proved greatly superior. • Thirty harmonics using an Hen- 
rici instrument is said to require from five to six hours, whereas the same 
results are obtainable by the optical instrument in about minutes. 



Frequency in Cycles per Second 


Fig. 18. Comparative analyses of the sound ou in out as determined by Henrici 
mechanical and Wente optical harmonic analyzers. {Montgomery, H. C., Bell 
System Tech. J., 17, 406, 1938.) 

A combined optical and electronic analyzer is the cathode-ray instru- 
ment devised by V. 0. Johnson ^ of the Westinghouse Electric & Manu- 
facturing Co. In operation, the waveform to be analyzed and the sine 
and cosine factors are supplied electrically, the former from the source 
under study, the latter from a good quality, variable frequency oscil- 
lator. The function f(^) is supplied to one pair of plates of a cathode- 
ray oscillograph. The cos m6 or the sin m6 factor in effect is supplied 
to the other pair. Properly adjusted, the trace on the face of the 
cathode-ray tube is a Lissajous figure whose complexity (Fig. 19) reveals 
visually which particular harmonic is under consideration. From the 
areas enclosed within two traces, one can determine the amplitude of 
a harmonic and its phase with regard to the fundamental. When deter- 
mining these areas, one must recognize that portions traced coimter- 
clockwise are positive and that those traced oppositely are negative, or 
^Johnson, V. O., Tram. Am. Inst. Elec. Engrs., 60, 1032 (1941). 
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vice versa. The results obtained by this method are said to check well 
with the tabular method. 

A more definitely electronic device is that manufactured by the Gen- 
eral Radio Co. It is described as a heterodyne type of vacuum-tube 



Fig. 19. A pair of Lissajous jfigures for determining a seventh harmonic as obtained 
by V. 0. Johnson, using his cathode-ray method. (J ohmon, V. 0., Trans. Am. 
Inst. Elec. Engrs., 60, 1032, 1941.) 

voltmeter (Fig. 20). The manufacturer states, “The output of the local 
oscillator and the whole of the complex waveform to be examined are 
fed to a balanced modulator where their combination produces both the 
sum and the difference frequencies, or side bands, in the output. The 
original of the complex waveform is not passed by the modulator 
intermediate-frequency output transformer, and the local carrier fre- 
quency is suppressed in the output because of the two-tube balanced 


Input multiplier 
(1 megohm attenuator) 



50,000 cycle 
"flattop" filter 


3 Stage amplifier 


Sidebands (P+0) and (P— Q) Upper aldebands 

carrier suppressed (50,000 cycles) 

Calibrated heterodyning, osclllstor Note: Amount of carrier (P), 

supplying carrier (p) at frequency lower sideband (P — 0,) and 

of 50,000 cycles minus frequency P±20, Px3Q, etc, negligible 

of component of "Q" under analysis here 

Fig. 20. Simplified diagram of the General Eadio Co. electronic harmonic analyzer. 


ftonfalnlnj cornponents ^ 

Between 6 & IMOO ^ for calibration 
qycles 


modulator employed. The 50-kilocycle component of the upper side 
band, proportional to the voltage of that frequency present in the orig- 
inal wave to which the main dial is set, is selected and amplified by the 
intermediate stages.” The current thus amplified is read in a meter. 
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An analysis requires dial adjustments one by one to the haimonic fre- 
quencies in the waveform under examination, adjustment -with each 
new component to a standard sensitivity for the fundamental, and re- 
cording of the meter readings. Only component frequencies and their 
amplitudes are obtained. No phase relations can be determined. The 
voltage uncertainty is said to be mthin ±5% on all ranges. This method 
is particularly suitable where the complex waveform is available as a 
continuously repeated emf in an electrical circuit. The analysis is then 
but a matter of a few minutes. 

Many other harmonic analyzers are described in the literature.^ 

16. Bettering the Approximation Involved When Only a Finite Num- 
ber of Terms of a Fourier Series Are Used. In harmonic analyses, such 
as that carried out above, one makes determinations of coeiScients as 
though coefficients for an infinite number of terms were to be used 
when applications w^ere to be made, and then in, fact stops with a finite, 
usually rather small, number of terms. A question naturally arises. 
Considering that only a few terms are to be used, would not somewhat 
changed values for the computed coefficients fit the data better? The 
answer involving least-squares procedure (Chap. XI) states that, given 
that the series is to be a harmonic series even though possessing a finite 
number of terms, the equation yielding the best fit has exactly the co- 
efficients given by the standard Fourier analysis. Even if but one sine 
or cosine term is to be used in representing a given function, the best 
coefficient for that term is that specified by Fourier analysis. To illus- 
trate, if one should attempt to represent the instantaneous power curve 
of Fig. 6 by a single term such as as sin 5^, the best value for as would 
be —5.38, the best equation, should both sin 50 and cos 50 be deter- 


mined, would be 


y = 6.3 sin (5^ - 146°) 


[ 68 ] 


Obviously, a trigonometric series, containing a finite number of terms 
whose coefficients have been obtained by the Fourier method, can be 
bettered only by increasing the number of terms. 

17. Summary. It is shown in this chapter that any cyclic function of 
an independent variable which is finite, single valued, and possesses 
only a finite number of finite discontinuities, may be represented by an 
infinite trigonometric series Imown as a Fourier series. It has been 
shown that these series are always convergent. Series of this type 
when integrated term by term are always convergent,, though it cannot 
be said generally that the series obtained by differentiation vrill also 
converge. 

^ Hall, Harry H., /. Acomtics Soc. Am., 8, 257 (1938). A general discussion of 
various types of analyzers is given. 
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With the angle 6 as the independent variable and 0 < ^ < 27r as the 
range, we have as the most general of Fourier series the whole range 
sine-cosine series 

b 

y = /(<9) = ^ 


Values for the coefficients are given by 


and 


1 

0/fn 

^2Tr 

1 y sin m0 dS 

[17] 

X . 

Jq 

&0 =- 

^2Tr 


I yde 

[19] 

X , 

yo 

= - 
'-'m 

X . 

^2it 


1 y cos m0 dd 

/o 

[20] 


Eq. 1 with coefficients evaluated may be changed to a form which 
is generally more useful for practical purposes, namely 


where 

and 


: f(^S) = ~ + ^2 

wi= 1 

= ^ + ^2 ” i) 

m= 1 ' ' 

~ “f" 

-1 


g — tan 


[ 6 ] 

[7] 

[ 8 ] 


Still another form, containing the imaginary i, useful in theoretical 
physics, to which Eq. 1 may be converted is 


h 1 

2/ = /W = J + 2 Z) [11] 

W=1 

There are two half-range series. With point symmetry for the cyclical 
function about points on the 0-axis at 0 = 0, x, 2x, etc., the coefficients 
of the cosine terms of Eq. 1 including bo become zero and the series 
reduces to the half-range sine series 


00 

y = fi{9) = ^2 ^ 


[29] 
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where 


2 n 

= “ / /i (^) shi HUB do 

^ Jo 


With line S 3 nnmetry for the cyclical functions about lines perpendicular 
to the ^-axis at ^ == 0, x, 2 t, etc., the coefficients of the sine terms of 
Eq. 1 become zero and the series reduces to the half-range cosine series 



y = / 2 (^) = ^ + ^ COS me 

[31] 

of which 

m~ 1 



2 

^0 = -' / /2(0) 

IT ^0 

[32] 

and 

2 , 



Pm — - 1 /2(^) COS 

T Jo 

133] 


Series representing y = f{6) may be transformed at once into series 


representing y = f 


(i‘) 


OT y = f xj,of which Y is a period of 


vibration and X a wavelength, by substituting for 8j (2w/T)t in one case 
and (2'ir/\)x in the other case. 

Thus for the former case corresponding to Eqs. 1, 17, 19, 20, 29, 30, 
31, 32, and 33 we have 

2/ =/(y * 5 ) = ^ + + [42] 


m= 1 
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,=a(|,)_^-»+|:,'.oos(»|<) [47] 

4 /2ir \ 

/S'o = yjr /2(^-y7^^ 

^ ^I'/2 / 2 ^ \ ' / 2ir \ 


Equations exactly like Eqs. 42 to 48 are obtained when 0 in Eq. 1 


is similarly replaced by 




and X replacing T and t. 


For the case of a noncyclical function in which in effect the wavelength 
X extends from a; = 0 to x = co , the whole-range sine-cosine series trans- 
forms into the Fourier integral 


Fix) 


1 /^oo 

= — / du I Fill) cos viii 

27r^__« Jo 


x) dll 


Jo <ai < 00 


[58] 


Where the function extends indefinitely in both directions, we have 

Fix) = “ / dv I Fill) cos viii — x) dll [59] 

the right-hand member of which is known as Fourier^s integral. 

Four frequently occurring special cycles consisting of a positive and 
a negative loop yield simplified series. Case I. If the areas of the two 
loops add up to zero the bo, ^o,^ot Vq term is zero. Case II. If the 
positive loop is asymmetric and the negative loop is a displaced image 
of the positive loop, the series satisfying the function is a whole-range 
sine-cosine series containing odd terms only. Case III. If the positive 
loop is asymmetric and the negative loop possesses point symmetry 
with respect to the positive loop, the series satisfying the function is a 
regular half-range sine series. Case IV. If the positive loop is sym- 
metrical and the negative loop possesses point symmetry with respect 
to the positive loop, the series satisfying the function is a half-range 
sine series containing odd terms only. Cosine series may be obtained 
for Cases III and IV if, in effect, the origin is shifted along the 0-axis 
by t/2. 

The coefficients for the series terms involve integrations. Often the 
function to be integrated is not expressed mathematically and it is neces- 
sary to resort to tabular or mechanical integrations. Tabular integra- 
tions as illustrated in Table I are usually time consuming. Further, the 
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coefficients for the higher harmonics tend to become progressively more 
and more imcertain. Mechanical integration, however, once the func- 
tion is properly graphed, becomes a simple matter for a de\dce such as 
Henrici’s rolling sphei^e harmonic smalyzev. The time required is very 
much shorter than for the tabular method. Further, it yields coefficients 
for the higher harmonics mth approximately the accuracy attained for 
the fundamental. Other de\dces generally less accurate but much more 
rapid in operation are available. 

Least-squares treatment shows that, if a finite number of terms of a 
Fourier series only are to be used in representing a function, the best 
values for the coefficients are just those occurring in the solution for an 
infinite' series. 


PROBLEMS 

1. Determine the whole-range sine-cosine series to represent y = 9^ for the range 

0 < 0 < 27r. 

2. Express the result of Problem 1 aa a harmonic series in which relative phases 
of the various harmonics are shown. 

3. In certain amplifications of photoelectric currents the light beam is ^ ^chopped” 
regularly to give an illumination E for the time interval T/2 and no illximination for 
an equal time interval and then an illumination E once more for the interval P/2, etc. 
What is the harmonic series that represents the illumination? 

4 . What is the harmonic series that represents a “chopped’’ illumination such as 
described in the preceding problem except that the illumination, and no illumination 
intervals are 2P/3 and P/3? 

5. Find the half-range sine series for the broken line y = 0 for the range 0 < 0 < 
'r/2, y = tt — ^ for the range 7r/2 < B < 37r/2, and y = — 2x 6 for the range 

3x/2 < e <2Tr. 

6. Find the half-range cosine series for the broken line y ^ B fox the range 
0 < 0 < 7r/2, y = Tr/2 for the range 7r/2 < B < 37r/2, and y = 2% — Biox the range 
3':n'/2 < 0 < 27r. 

7. Assuming the portion of Fig. 54 for the region 0 < ^ < 27r to consist of two 
right-angled triangles with 30° as the smallest angle, compute and compare the two 
Fourier series obtained first when the origin is located as shown and second when the 
origin is located instead at 0 — x, 

8. The cycle of the graph of displacement of a point on a vibrating string shows 
two self symmetrical loops which are symmetrical with respect to a point on the time 
axis. Measurements of displacement at the indicated phase angles give the following 
values: 

Phase angles in 

degrees 5 15 25 35 45 55 65 75 85 

Displacements 

in cm +0.041 -0.013 +0,054 -0.017 - 0.023 +0.125 +0.424 +0.771 +1.001 

Graph the function and make a harmonic analysis. 

9. Compute the fifth harmonic for the data of Table 1. 

10 . Find the half-range sine series to represent Fig. 2. Follow the suggestion in the 
text by assuming ^ = B/2. 
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THE NORMAL FREQUENCY DISTRIBUTION 

1. Introduction. The basic problem of every quantitative experiment 
is that of determining directly or indirectly what we call the .“true 
value” of a quantity — the period of a pendulum, the normality of a 
solution, etc. Strictly speaking, we can never measure the true value 
of any quantity; we can obtain only an approximation thereto. By 
refining our methods of measurement, we can obtain closer and closer 
approximations, but there is always a limit beyond which refinements 
have not or cannot be made. It is thus desirable to know in any par- 
ticular case just what relation the measured value bears to the true value. 
For obtaining this information, a knowledge of the law of frequency 
distribution of measurements is of great value. 

Consider, for example, the measurement of the prism angle, X, of a 
60° prism on a spectrometer with a scale which can be read to 0.001'. It 
will be found that, though all readings are taken with equal care, suc- 
cessive measurements will not agree with one another. In a particular 
case, assume values of 


60° 0.320' 

60° 0.320' 

.318 

.319 

.317 

.322 

.320 

.320 

.321 

.319 

.319 

.321 


to be obtained. Given only this list of values, the question arises, what 
value shall be taken as being probably nearest to the true value. We 
may take the arithmetic mean, X - SX/n; the geometric mean, 
X g = -V^Xi XX 2 - --X„; the root mean square mean, Xms = 
'V'^(Xi^ -j- Xs^ -t-- • -Xn^)/?!; the median, the middlemost value 
when listed in order of magnitude; the mode, Mq, the value of X which 
occurs most frequently; or any one of a number of other such values. 
Or, with perhaps some slight justification, we might reason that since 
in the past our measurements have usually been higher than those 
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obtained by others, we should regard the smallest value as the best 
approximation to the true value. 

Consider now the frequency distribution of the above series of angle 
measurements, showing how often, relatively, the various actual values 
occur. The plot of Fig. 1 is a very convenient method of presenting an 
over-all view of the spread of values and the general nature of the distri- 
bution. It shows, among other things, that the reading 60° 0.320', 
representing the angular interval 60° 0.3195' to 60° 0.3205', is obtained 
four times; and, as indicated by the ratio of the area of the rectangle 



Fig. 1. The frequency distribution for twelve readings of a certain prism angle. 
The least count, the smallest amount by which two measurements can vary and 
still be detected as unequal, is 0.001' in this case. 

centering at 60° 0.320' to the total area under the curve, that the rela- 
tive frequency of occurrence of this reading is 
If the number of measurements were increased indefinitely and the 
least count made as small as possible, the distribution curve would appear 
less steplike and in the limit would become smooth. This smooth curve 
is the infinite parent distribution of the measurements. The observed 
set of twelve measurements may be thought of as a sample set from the 
indefinitely large number of measurements which make up the parent 
distribution. The equation of the parent frequency distribution curve 
is referred to as the law governing the distribution of the observed 
measurements. Knowing this law, it is possible to arrive at a value 
for the measured quantity which, except for instrumental errors and 
personal idiosyncrasies of the observer, we can justly declare to be the 
most probable value. 

Depending on the assumptions made, several forms of frequency dis- 
tribution laws have been obtained. Which is most likely to govern the 
distribution of a proposed set of measurements is generally impossible 
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of prediction in advance. However, the normal distribution law, or, as 
it is sometimes called, the law of errors, seems to fit observed distribu- 
tions in a great number of cases. Further, the normal law is one of the 
simplest, containing only one arbitrary constant; and many of the other 
distribution laws reduce to the normal law under suitable limiting con- 
ditions. Because of our desire for this simplicity, we often mistakenly 
assume that the normal law governs all distributions of measurements. 
For many distributions, however, this assumption is obviously im- 
possible. 

In this chapter we first present Hagen^s derivation of the normal 
distribution law and then explain its physical interpretation. The pro- 
cedure of normalization of the law is carried through, and its significance 
in describing probabilities is discussed. The precision indexes associated 
with the normal distribution are then defined and explained. Finally, 
we derive the criterion of least squares, and show that for a distribution 
governed by the normal law, the mean is the most probable value. 

2. Hagen’s Derivation of the Law of Normal Frequency Distribution. 
The normal law may be derived, using various sets of basic assumptions. 
The assumptions used by Hagen seem to simulate physical conditions 
moderately well and to permit of a simple derivation. The derivation 
follows. Hagen assumed (1) that errors unavoidably enter in each of a 
series of measurements of a quantity, (2) that each of these errors may 
be thought of as being composed of a great number of very small equal 
elementary errors, and (3) that in any measurement, an elementary 
error is as likely to enter in a positive as in a negative sense. 

To illustrate these assumptions, we shall assume that the arithmetic 
mean, 60° 0.3197', of the measurements reported above is the true value, 
though we shall see that this is not at all necessarily the case. The 
deviation of the first reading from the assumed true value— i.e., the 
assumed error of the first reading — then becomes 0.0003'; that of the 
second reading, 0.0017'; etc. The frequency of occurrence of these errors 
for the group as a whole is shown in Fig. 2. , The distribution is identical 
in form with that given in Fig. 1. Each error, in view of the assump- 
tions, is to be thought of as due to many minute errors which may be 
associated with , the temperatures of the various parts of the spectrom- 
eter, irregularities of instrumental calibration, uncertainties of position 
of the eye when reading, peculiar tendencies of the reader, and a host 
of other causes which one may conjure up if so inclined. Each of these 
minute errors, if one is so minded, may be broken up into a number of 
smaller elementary errors. For the purpose of the derivation it is neces- 
sary, as stated, to assume that these elementary errors are all of the 
same magnitude and that each occurs as often negatively as positively. 
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The way in which any particular elementary error enters in a particular 
measurement would be, of course, quite beyond our power to control 
or to predict. 

Let 8 be the magnitude of one of the assumed equal elementary 
errors entering a measurement. The probability that any 8 will enter 
positively is 3^; the probability that it vill enter negatively is also 
If there are m of them, the probability that aU the vail be 


Fig. 2. 



“0.004 “0.002 0.000 0.002 

Error in Minutes of Arc 

The frequency distribution of the errors of twelve readings of a certain prism 
angle, assuming the arithmetic mean to be the true value. 

4 


positive, thus yielding an error of -\-m8, is evidently 




The prob- 


ability that all 5’s but one will be positive, and that the resultant 


error is 


is +(m - 2)6, is m X 


The factor m appears 


here because there are m ways in which the combination of errors 
under consideration can take place. Similarly, the probability that 
only (m — 2) 5’s wall be positive, giving a resultant error of + (w^ — 4)5 
m(m “■ 1) ^ 02- 


IS 


2 ! 

of the term 


or, 


2! 


VO/XXV ^ 

(i)' 


The coefficients 


(IT 


are seen thus to be the coefficients in the binomial 


expansion of (a + Table I follows. 

In Fig. 3, the computed probabilities, dF, are showm as small rect- 
angles, each 25 wide. In the limit, as 5 0, the height of a rectangle 

becomes the ordinate of a point on a smooth curve. This ordinate is 
called a probability coefficient and is defined by 



[ 1 ] 




Probability of Occurrence 
Unit Error Interval, y 
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TABLE I 

The Relation Between the Component Elementaky Erroeb and the Re- 
sultant Errors Occurring in Measurements, and Their Probabilities op 
Occurrence According to Hagen^s Treatment 


Number of 
Elementary Errors 

The Resultant 
Error, x 

Its Probability 
dP 

Positive 

Negative 





fiY 

m 

0 

m8 


[v 





fiy 

w — 1 

1 

(m — 2)5 

m 1 

[V 

m —2 

2 

{m — 4)5 

m{m — 1) 1 





2! ' 

KV 

m — 3 

3 

{m — 6)5 

m{m — l)(m — 2) j 

oy 




31 ' 

w 



* ♦ 

mim — 1) • • • (m — 71 + 1) i 


m — n 


, (m — 27^)5 

.1 1 

^2/ 




m{m — !)• • - (TTt -■ n) j 


m — 71 — 1 

n + 1 

{m — 2n — 2)5 

{n + 1)! ' 

^2/ 



Fig. 3. The probability of an error occurring in measurements as a function of the 
error, according to Hagen^s treatment. 
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where dP represents the probability of an error lying between x — 
and X + Physically, y is related to P and to x just as a velocity 

is related to distance traversed and to time. 

We seek the equation of a continuous curve which represents the case 
where the elementary error, 5, becomes indefinitely small, and the num- 
ber of elementary errors, m, increases without limit. This may be ob- 
tained by (1) determining the Atz/Ao; betw^een the tops of adjacent ele- 


im I — J , 
^0 VAo;/ ^ 


mentary rectangles of Fig. 3; (2) obtaining the corresponding lim 

A*— i-O 

or, dy/dx; and, (3) integrating dy/dx with respect to x to obtain y = fix). 
Following this plan and using the points of Fig. 3 corresponding to the 
errors [= (m — 2n — 2)5] and Xn[= {m — 2n)5], we have 


m — n 

Vn ^ Vn 

^ _yn — Vn+l n + 1 _ ynTYi — 2n — I 

Xn — Xn+i 25 25 n + 1 

Noting, except for the tails, that n ^ 1, and that for the error Xn 


2n = m-^ [3] 

6 

we may write, in the limit, for the region where the errors are small in 
comparison with the maximum possible error, i.e., where x<SCm 6 


X 

dx 25 m X 
2'~¥5 


yx 

m5^ 


W 


The error m5, ^that occurring when the elementary errors are either all 
positive or all negative, is relatively very large; 5, on the other hand, is 
one-half the minimum variation in errors, and is infinitesimal in com- 
parison. The product m5^ is finite, however, and is of importance in 
the discussion of the law. Customarily the fraction l/m5^ is replaced 
by The significance of A, which is called the “modulus of precision^’ 
will be given later. The differential form of Eq. 4 then becomes 

^ - 2h^yx [5] 

y = 


whence, finally. 


[ 6 ] 
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This is the standard form for the normal law of errors, or more appro- 
priately and more generally, as will soon appear, the law of the normal 
frequency distribution. 

A plot of Eq. 6 in which x stands for an accidental error ^ of measure- 
ment is shown in Fig. 4. In conformity with Fig. 3, the curve has a 
maximum at rr = 0, is symmetrical with respect to the y-axis, and 
approaches the rr-axis asymptotically at both extremes. Actually, be- 
cause of the manner of derivation, it occurs that Eq. 6 is only an approxi- 
mation to what is called the binomial distribution law in which an 



infinite number of infinitesimal elementary errors occur. The two dis- 
tributions differ most in the regions that are referred to as tails. On a 
percentage basis, the failure to check increases with the magnitude of 
the error. 

Another method of derivation, due to Gauss, starts with the assump- 
tion that the most probable approximation to the true value of a quan- 
tity of which many determinations have been made with equal precision, 
is the arithmetic mean of those determinations. His procedure leads 
finally to the result obtained by Hagen, namely, Eq. 6. As is to be 
expected, and as will be shown, granted Eq. 6 as a conclusion 
of Hagen^s reasoning, we may deduce Gauss's assumption as a con- 
sequence. 

Although here derived on the basis of errors occurring in a number 
of measurements of a single physical quantity, Eq. 6 is often useful for 
representing other types of frequency distributions. Thus, the frequency 
distribution of the weights of a large number of apples, picked at random, 

^ We refer here only to such errors as may be classed as accidental. None of the 
types that may be classed as systematic errors, or that are due to theoretical con- 
siderations, enter into the law of normal frequency distribution. 
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can also be represented rather closely by it. It is meaningless/ of course, 
to speak here of a ^^true value’^ for the weight of an apple or of the 
combined influence of a great number of “elementary errors.” It is 
proper, however, to speak of deviations from a mean weight or some 
similar value, caused by variations in such elementary factors as the 
age of the tree, the cultivation it receives, the type of soil, the climate, 
the size and health of the branch, the location of the apple on the branch, 
the amount of surrounding foliage which may cut off sunlight, etc. In 
the discussion to follow, therefore, we refer to x-values sometimes as 
'^errors,” but more often as de\dations. 

Frequency distributions are often desired for other purposes than 
those of obtaining “best” values from groups of measurements. A 
knowledge of the distribution of the sizes of a sample group of manu- 
factured products tells whether the batch from which the sample 
came is sufiSciently close to the size specified, whether proper manufac- 
turing conditions are being maintained, etc. A shoe manufacturer 
would want to know the distribution of foot sizes in the population in 
which his products are sold in order to properly apportion his produc- 
tion. A botanist would obtain the distribution of sizes of a number of 
samples of a certain plant grown under special conditions and compare 
it with the distribution jjf sizes obtained under ordinary conditions to 
see whether or not the special conditions produce a significant change in 
the size of the plant. 

In general, as will be shown in the following chapter, a randomly 
chosen distribution will not follow the normal law. Nevertheless, so 
many distributions do approximate this law, within the limits of 
experimental or sampling error, that the concept of the normal law is 
of great value. We should think of the normal distribution law not as 
one which all types of measurements must obey, but as a simple and 
convenient law .applicable to many distributions whose graphs have the 
general shape shown in Fig. 4. ^ 

3. Gallon’s Quincunx. Of interest here is Galton’s quincunx, a piece 
of apparatus which is based on Hagen’s assumption that a very large 
number of small elementary errors enter to determine an actual resultant 
error in a measurement. Once set in motion, the quincunx automatically 
yields a binomial frequency distribution which resembles the normal 
distribution and lends plausibility to Hagen’s method of derivation. In 
design (Fig, 5), as suggested by its name, it is based on an arrangement 
of five pegs, four of which are at the corners of a square, with the fifth 
at the center. Small shot, falling down through the small hole in the 
hopper at the top, receive small sidewise impulses directed with equal 
probability to the right and to the left as they impinge upon the quin- 
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cunx array of pegs, and are finally collected in bins at the bottom. The 
upper boundary of the collected shot approximates a curve of the form 
of Eq. 6. 




Fig. 5. Galton's quincunx, a device for illustrating the physical basis of the normal 
frequency distribution law. 

4. The Constants h and h of the Equation y = As shown in 

Fig. 6A, varying the constant A, keeping constant, results when 
graphed in a series of curves which differ only in their lateral spreads.. 
Similarly, varying /c only results in a series of curves which differ, as 
shown in Fig. 6J5, only in their vertical extents. Any one curve may be 
obtained from any other by appropriate expansions and contractions 
laterally and vertically. Since a large value for h corresponds to a 
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small spread of measurements, h is appropriately a modulus of precision. 
The significance and the evaluation of h, however, are less evident. 
Instead of considering k itself, consider the significance of Eq. 6 as a 
whole. Assume a group of measurements with least count Arc, whose 
deviations from their mean obey the law of Eq. 6 . Then the probability 
that a randomly chosen measurement has the deviation Xi is 2/iAx;' the 
probability that it has the de^dation is etc. Further, the prob- 
ability that its deviation is either Xi or rr2 is (2/1 + y^Ax. Thus, the 
probability that its deviation lies between — and + 00 is ISyAx, This 
sum contains the y^s corresponding to all possible re’s between — 00 and 



X 

(A) 



- 1.5 - 1.0 - 0.5 0.0 0.5 1.0 l.£ 

X 


(fi) 


Pig. 6. Grapbs ofy ^ he for varying values of h and h. In A the common value 
for h is 1.00. In B the common value for A is 1.00. 


+ 00. Since it is certain that the random deviation concerned lies 
between — 00 and + 00 , 'Ey Ax, represented graphically by the area imder 
the curve of Fig. 4 , must equal unity. As Arc 0 , we have 



1 


[ 7 ] 


Fig. 6 shows that for each h a, k may be determined to satisfy Eq. 7 . 
The procedure follows. 

6. Normalization of the Equation y = Here, the procedure 

is based upon analytical geometry considerations, though such is not a 
necessity. In Fig. 7 is shown the solid generated by rotating about the 
2/-axis the curve representing the positive half of the equation y = 
Let A /2 represent the area in the x-~y plane which is bounded 
by the curve and the rc- and ^^-axes, hence also the corresponding area 
in the y-z plane. Then 

e-^’‘^dx=2kl 


[ 8 ] 
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Further, since x and z are independent variables, we may write 

= 4 ) 1:2 f dz 

Jo Jo 

= 4J<? f f dxdz [9] 

Jo Jo 

Viewed geometrically with the aid of Fig. 7, evaluating the double inte- 
gral corresponds to determining the volume of the solid which is bounded 



Fig. 7. A convenient diagram for use in normalizing the equation y == 

by the x-z, the x-^y, and the y-z planes and the surface obtained by the 
rotation about the y-axis. For the element of volume indicated by ahcd, 
the common y-ordinate is where + z^, and the area of its 

projection on the x-z plane, dS, is (7r/2)r dr. For the volume, F, there 
follows 

V fydS = k f f dx dz 

J Jo Jo 

= ^ f“e-’^’‘^^rdr 
i Jo 
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The integration is simple. There follow 




kir 

4^ 


and 


= 4kV - 


k^T 

IF 


A 


k^s/lr 

h 


Since A is to represent a probability of unity, we have 


[ 11 ] 



[ 12 ] 


and for the normalized equation of the law of normal frequency distribu- 
tion 


Vx 


■\/ TT 




[13] 


Here yx is to be viewed as a probability coefficient which, when prop- 
erly expressed, has a unit attached. In case x is measured in seconds, 
h and y will be expressed in reciprocal seconds, and yx dx, an element 
of probability, mil be a numeric. The subscript x in Eq. 13 has been 
added to distinguish the probability coefficient there considered from 
other different but similar coefficients that will be considered later. 

Whenever it is desired to have the area under the curve represent a 
number of observations, n, we need only set k = nh/'\/~T so that 


nh 

yn = nyx = ~ 7 = e 

V TT 




[14] 


Although its units are the same as those for yx, yn itself is to be regarded 
as a frequency coefficient. Obviously, to fit the normal law to an ob- 
served set of measurements, it is necessary to find the proper value 
of h. 

6. Special Values of x Associated with the Curve y = (A/'\/i') 

— ^Precision Indexes. Four x-values of special significance, usually 
referred to as a group by the name precision indexes, are (1) l/h, the 
reciprocal of the modulus of precision; (2) a, the average deviation; 
(3) <j, the standard deviation; and (4) p, the probable error. They are 
defined with respect to Eq. 13 as follows: 
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1. The quantity l/h is that value of x for which the corresponding 
^-value is 1/e times the maximum ^/-value; i.e. 


{ysdnh = “ 
e 



[ 15 ]^ 


It is seen that high values for and narrow spreads go with high 
values for h. Since precise measurements yield distributions of this 
shape, h is appropriately a modulus of precision as already noted. 

2. The average deviation, a, is defined as the mean deviation with- 
out regatd to sign. Mathematically 



3. The standard deviation, cr, is defined as the square root of the 
mean squared deviation. In terms of Eq. 13, 



4. The probable, error, p, is that value of x which satisfies the re- 
lation 

h r+p 1 

The area under the normal curve between the limits p and — p is 
one-half the total area; and the probability of a deviation less thanp 
in absolute value is equal to the probaMity of a deviation greater 
than p. By means of tables we find p = 0.477/A. 

The relations of the precision indexes to one another for a strictly 
normal distribution are given by 


p : a : <r : I = 0.477 : 0.564 : 0.707 : 1.000 [19] 

and approximately by 

p:a:(T:I = 3j,:4:5:7 [20] 

1 It would be more logical to represent tbe second member of this equation as 
(j/®)o/e; but no other value such as (2/to)o is being used, hence the simplification. 
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The relative positions of the precision indexes on the curve of Eq. 13 
are shown in Fig. 8. The values of the ordinates corresponding to these 
special values of x are also indicated in terms of the maximum ordi- 
nate, 2 / 0 - ' - 

It is customary to indicate by a subscript the quantity to which a 
precision index applies. Where, as above, the indexes are obtained for 



Fig. 8. A graph of the law of normal frequency distribution, showing the relative 
positions of the precision indexes p, a, cr, and 1/h. 


a distribution of a^-values, it is proper to write them as 'Pxj 
and {l/Kjx, and to consider them as applying to the individual ^-values 
comprising the distribution. 

7. Tabiilar Representations for the Normal Curve. The calculation 
of 7^-values corresponding to given x-values in Eq. 13 is somewhat in- 
volved. Obviously, a table of corresponding x- and y-values would 
eliminate much computation. However, since the physical nature of x 
and the value of h both change from one distribution to another, such 
a table would, in general, be valid for only one particular distribution. 
If, however, instead of x, we use kx, or x/a, or x/p as the independent 
variable, a single table will cover all cases. Recognizing that for a given 
distribution regardless of whether deviations are expressed in terms of 
X, hx, x/cr, x/p or otherwise, the probabilities associated with given 
ranges of measured values must remain invariant, we may write at once 

“ VxIp d 



Vxdx =yhx d{hx) — d 


[ 21 ] 
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of which yhxy Vx/a like 2/a;, represent probability coefficients. For 
the case involving hx as the independent variable, we have, as is evident 

Vx = Vhx = nyhx [ 22 ] 

With the aid of Eq. 22, one may easily obtain a distribution of yx 
once given tabulated values of 

Vhx = f(hx) ^\yx= -4= 
h \/t 

as in Table I of Appendix 2. To illustrate, the yx corresponding to 
h = 5.0 cm"“^ and x = 0.10 cm, is obtained as follows. From the table, 
the value of yhx for hx = 0.50 is seen to be 0.439. Multiplied by A, 
there results 2.20 cm~\ the desired yx- 

Frequently a normal frequency distribution curve is fitted to observed 
data in order to find the expected probability of occurrence of a 
deviation lying between xi and X 2 - For this purpose we desire a conven- 
ient method for obtaining the probability, Pxf of a deviation lying 
between —a; and +a:, for we may then express the probability of a devia- 
tion lying between xi and % by one-half of the difference Px^ — Pxi^ 
The value of Px is represented graphically by the area under the normal 
curve between the limits —x and +Xj or mathematically, by 



To evaluate Px we may (1) draw the normal curve and measure the 
designated area with a planimeter; (2) calculate or obtain from Table I 
of Appendix 2 a series of ordinates between 0 and x and apply a quad- 
rature formula; (3) express in series form and perform the inte- 
gration indicated by Eq. 24 for each term; or, preferably, (4) make use 
of tables giving probability summations. The results obtained for each 
of the first three procedures, showing Px as a function of rr, are valid 
for only one distribution. Obviously, a probability table is desired 
whose values are independent of both the nature of x and the value of A. 
One such is obtained when hx is used as the independent variable. The 
evaluation for the normal law may then be written 

2 

P^ = Ph^ = -y= / e-^’^^UQix) [25] 

V’T Jo 

A table showing P^x as a function of hx such as is found in Table II of 
Appendix 2 applies to all normal distributions. If, for example, for a 


= /W, 
[23] 
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distribution where h ^ 5 we wish to know the probability of a 
positive deviation less than 0.1 cm, we first note that hx = 0.5, and then 
read the desired probability from the table as one-half of Po.i cm = Pihx^Q.5) 
= 0.520 or 0.260. On the other hand, the probability of occurrence 
of a deviation, either positive or negative, less than O.hcm is P(Ax=o. 5)7 
or 0.520. 

In practice, a and p are used much more often as precision indexes 
than is 1/A. In consequence, values for P^/^ and Pxjp as functions of 
xla(^ hx/0.707) and of x/p{= hx/0A77) are often desired. Such values 
are readily obtainable from the table just referred to. 

Illustrating the use of Table II of Appendix 2 with respect to P^/^, 
consider the following. Given that the standard deviation for the lateral 
deviations of target hits from a central vertical line is 15 inches, and 
that the frequency distribution is normal, what is the expected per- 
centage of hits falling within the 15-inch range? What range of devia- 
tion will probably include 90% of the hits? Replying to the first ques- 
tion, it is apparent that we seek the value of P( 3 ./^=i). We first find the 
value of hxi— x/\/2 a) that corresponds to x/a = 1. It is 0.707. 
In the table we find the corresponding Ph,x to be 0.683. Obviously 
this is also the desired P(^x/<r=-i) and the percentage is 68.3%. Reply- 
ing to the next question, we seek first the hx which yields 90% for the 
corresponding Phx, and then the corresponding a;/cr and x. These values 
in turn are found to be 1.16, 1.64, and 25 inches. 

Similarly, filustrating the use of Table II of Appendix 2 with respect 
to Pxip, consider the following questions. Given that the probable error 
for the masses of bearing balls of a certain group is 15 mg and that the 
distribution is normal, what is the expected percentage of balls whose 
deviations are at least 30 mg or 2pf What is the minimum deviation 
from the mean mass that will include 99% of the balls? The procedure 
here is very similar to that used just above. Replying to the first ques- 
tion, we seek the value of P{x/p^ 2 y The corresponding hx{ = 0A77x/p) 
is 0.954. The corresponding P^x is 0.823. This is the desired Pxjp 
and the answer is unity less 82.3% or 17.7%. Replying to the second 
question, for a Phx of 99%, the table indicates an hx of 1.82. The corre- 
sponding x/p and X are 3.81 and 57 mg. 

8. The Arithmetic Mean of a Set of Measurements. We return now 
to the question raised at the beginning of this chapter: given n measure- 
ments of a quantity, Xi, X 2 , * * *X„, all taken with equal care, what, on 
the basis of the normal frequency distribution, is the most probable 
value of the quantity? As an aid in finding this value, we introduce 
X'^, an arbitrary function of all the measurements. It may be 
conveniently thought of as a variable pseudo-mean whose value 
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depends on the method of formation. We may, if we wish, define jt by 



where to, as a variable, may have any value ranging from 0 to oo. 
Let x"i, x"z, • ■ ■x"n be the deviations of Xi, X^, ■ ■ -Xn from X". On 
the basis of the previous discussion of the nature and the distribution 
of errors, it is now assumed that the preferred value of X" is that for 
which the corresponding combined probability of simultaneous occur- 
rence of x''i, x" 2 ,-- -x^'n is a maximum. If the set of measurements 
obeys the normal law, the probability of occurrence of the deviation 
x''i, i.e., the deviation lying between x"i and x"i -f Ax" where Ax" is 
the least count of the set of measurements, is given by 

XPxr'i — — yx"i [27] 

Similarly, 

Ax", etc. [28] 

The combined probability of the deviations x"i and x''^ both occurring 
in the order specified is then given by 

(A^-P)a/'i, = APy,j APa^/j = (Ax")^ [29] 

Hence, ,the condition that the combined probability oif occurrence of 
x"i, x" 2 , • • •x"n should be a maximum may be written as 

(A”P)*"j,...i«„ = g-AW'2 _ Q maximum [31] 

or, in logarithmic form, as 

ln(A"P)a/'i, . . . = In ^ J — h^hx"^ = a maximum [32] 

The conditions which must be fulfilled in order that Eq. 32 may be 
true are 

^[ln(A”P)^,^....^,J =0 [33] 

and 

[^(A”P)a:"i, ••-*"„] < 0 


[34] 
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As the first derivative, we have 


d 

dX" 




d(Sx"2) 

dX" 


= 2AV'i+:r"2+--V'„) 


dX") 

[35] 


The step el imin ating the derivatives Js a consequence of the definition 
of an namely that x"]c = Xk ~ X" and that accordingly 


dx" k 

dX" 


[36] 


As the second derivative, we have 

^^//2 ■ • *" n ] 

= I2h\x\ + x"2 + • • -x^n)] = [37] 

Applying the condition of Eqs. 33 and 34 requires that 

x"i+rc"2+--*a;"n = 0 [38] 

and 

-2n}? < 0 [ 39 ] 

It is at once evident that the latter of these two equations is true and 
that the former fulfills the condition that X" shall be the arithmetic 
mean of the given n measurements. 

The conclusion just derived with the aid of the normal frequency 
distribution law, as noted above, was used by Gauss os the fundamental 
assumption on which his derivation of the law was based. 
Rearrangement of Eq. 32 yields 

_ o 1 , /AAxV . , . 

^ In — a maxmaum = a minunum [40] 

where now an x represents the deviation of an individual measurement, 
X, from the mean, X. In this form one sees that the assumptions (1) 
that the measurements follow the normal distribution law and (2) that 
the combined probability of occurrence of the observed deviations from 
the mean is a maximum lead to a least value for This is the basis 
of the well-known principle of least squares. 
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9. Summary. A knowledge of the law of frequency distribution gov- 
erning a set of data is often valuable as a means to an end, e.g., in find- 
ing the best value of a series of angle measurements, or as an end in 
itself, e.g., in helping a shoe manufacturer to decide how to apportion his 
production. A great number of such laws have been derived. One of 
the simplest and most applicable is the normal distribution law 


Vn — 




Here x represents the deviations of the observed values from their arith- 
metic mean; h, the modulus of precision, is a constant whose value 
depends on the precision of the data, i.e., the spread of the observed 
values about their mean; n is an arbitrary constant usually set equal 
to 1 or to the total number of observed a;-values; and y has the nature 
of a frequency coefficient or a probability coefficient, depending on 
whether n equals the number of observed values or unity. 

Special values of x of interest are (1) the arithmetic mean of the 
a;-values, for which the corresponding has its maximum value, y^] 
(2) the reciprocal of the modulus of precision, 1/A, whose corresponding 
2 /-value is yo/e; (3) the average deviation, a, for which ya = 0.7282/o; 
(4) the standard deviation, cr, for which y^ = 0.607yo; and (5) the prob- 
able error, p, for which y^ = 0.797^o- The quantities 1/A, a, o', and p 
are called precision indexes and are related by the equation 


p:a:(T:^ = 0.477 : 0.564 : 0.707 : 1.000 [19] 

The quantity Pxj defined by 



[24] 


represents the probability of occurrence of a deviation not greater than 
X in magnitude. The probability of ^ deviation between Xi and X 2 in 
value is then — Px^ The probable error is that value of x for which 

Values of yn in Eq. 14 corresponding to specific a;- values are most 
conveniently obtained from Table I, Appendix 2, showing 



Vhx ~~ 



[23] 
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Values of in Eq. 24 corresponding to specific x-values are similarly 
best obtained from Table II, Appendix 2, showmg 

2 

= — [25] 

Jq 

The assumptions (1) that measurements obey the normal distribu- 
tion law and (2) that the combined probability of occurrence of observed 
deviations from the best value is a maximum leads to the conclusions 
(1) that the arithmetic mean of a set of measurements is the best approxi- 
mation to the true value of the quantity measured and (2) that the sum 
of the squares of the de\dations of the obsen^ed values is a minimum 
when the deviations are taken from the mean. Conclusion (2) is the 
basis of the principle of least squares. 

PROBLEMS 

1. Plot, on the same set of coordinate ax^, binomial distributions whose succeed- 
ing ordinates correspond to succeeding coefficients of (| + and (| + 

Make the total widths and the areas included under the two curves the same. 

2. Plot to scale, on the same set of coordinate axes, two normalised curves such . 
that the modulus of precision of one is twice that of the other. 

3. With the aid of tables, find, for one of the curves of Problem 2, the values of x 
for which Px has in succession the values 0.2, 0.4, 0.6, and 0.8. Draw vertical lines 
on the plot at the appropriate abscissas. 

4. What are the values for that correspond to values of Ifh of (o) 2 sec, 
(5) 150 cm/sec, (c) 40 in., .0) 3 sec/day? 

6. Where l//i is 2 ft and the least count is 1 in., what is the probability that three 
randomly chosen measurements, regardless of the order of their t^ng, will have 
deviations of 8 in,, 16 in., and —4 in.? What, if the order is specified? 

6. Show that the curve of the normal distribution law has inflection points at 

X = ±cr. 

7. A value which has been quoted for the rest mass of the electron m is 9.1154 X 

10”^®(1 ±0.00018) gm, of which ±0.00018 has the significance of a fractional probable 
error and is equal to On the basis of the above statement, determine the 

probability that the value given is correct (1) to within 0.0005 X 10“^^ gm, (2) to 
within 0.00010 X 10'"^® gm. 

8. A value quoted for the calcite grating space at 20° C is 3.03560 (1 ± 0.00002) A 
(see Problem 7). On the basis of the above, deteimine the standard deviation and 
the modulus of precision for the quantity and the probability that the result is cor- 
rect to within 2.57flr. 
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THE NORMAL FREQUENCY DISTRIBUTION (contmued) 


1. Introduction. In the preceding chapter we discussed the deriva- 
tion and the. interpretation of a theoretical frequency distribution, the 
so-called normal distribution 


Vx ^ 




[ 1 ] 


It was there noted that any observed set of values, assumed normally 
distributed, is to be considered as a sample set from an infinitely large 
parent group of measurements whose frequency distribution has the form 
of Eq. 1. 

In this chapter we shall describe the relation between the sample and 
the parent distributions in greater detail. With this purpose in 
we discuss first the procedure of fitting the best normal curve to a given 
distribution, and then we develop short methods of finding the mean 
and the precision indexes. Some uses of the precision indexes are de- 
scribed, and criteria are obtained for the rejection of observations pos- 
sessing unduly large deviations from the mean. Limitations of the nor- 
mal law are then presented, and certain tests for goodness of fit of the 
normal law to an observed distribution are described. 

2. Quantitative Evaluation of Precision Indexes. The process of 
fitting the best normal curve to an observed distribution is, in effect, 
that of determining the most probable distribution of the infinite parent 
group. For this purpose, the calculation of only one constant, the mod- 
ulus of precision, h, is required. 

Given n equally precise measurements of a quantity Xj, 
with deviations xi, x^, •■■Xn from the mean X, the assumption is made 
that the desired modulus of precision is the modulus which ascribes to 
the observed data a maximum of probability of occurrence. Assuming 
the normal law, the probability that the readings will occur in the order 
given is 

[ 2 ] 

I maximum 
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or in logarithmic form 

Tit 

In = nlnA — 2 ^^^ ““ + nln (Ax) = amaximinn [3] 


Differentiating with respect to h, to obtain the modulus associated with 
the maximum probability of occurrence, yields 


whence 


or 


I [In = 0 [4] 


n 

~ 22,01? 

■ [5] 

1223? 

[6]‘ 

\ 

’ n 


A second differentiation of Eq. 3 with respect to h yields ‘-nfh^ — 2Xx^j 
a quantity which is essentially negative and indicates that the relation 
expressed in Eq. 6 corresponds to a condition of maximum probability 
for the given measurements. 

In view of Eq. 6, the most probable values of the precision indexes 
for an individual observation are given by 


and 



p = 0.6745(r = 0.6745 




[7] i 

[8] ‘ 

[9] 


^ Many authors differentiate between the precision indexes l/h, o-, and p computed 
for the individual readings of the sample group and the corresponding precision 
indexes for the infinite parent group. These latter values are assumed to be more 
worth while. That the mean of this latter group shall coincide with that of the 
former group is not to be expected. Consequently the deviations x which have been 
treated above are not deviations from the true value of the quantity measured, i.e., 
the mean of the infinite group. Obviously, could deviations from this unknown 
mean be used in computing for our sample group the values of l/h, a, and p, the 
term would be greater than that actually found. Statistical theoiy gives for its 
most probable value nZx^/(n — 1). It follows that the precision indexes then 
obtained are greater than those represented in Eqs. 6, 7, and 8. They are obtained, 
in fact, by replacing the n of those equations by n -- 1, and are so found in many 
texts. The present authors, however, are deviating from this policy. There are 

- Tre X 1 1 r xT*_ £ ttk ; £t n o 4.1... 
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As precision indexes, p and a are used more often than a. That this 
should be the case, despite the evident greater ease of determining an a, 
seems to be largely due to a discovery by Gauss. He found that p and 
cr, as defined above, were 14% more effective than a, and 9% more effec- 
tive than (So;^) another possible precision index. Expressed otherwise, 
the p ox (T from 100 observations is as precise, relatively, as the a from 
114 similar observations. (See page 196.) Because of the foregoing, we 
shall, for the most part, from now on, ignore a as a precision index. 
Further, when describing precision indexes for quantities, following cus- 
tom, we shall ignore 1/h also and emphasize only p and cr. 

To fit the normal curve, we need only calculate h and substitute in 


Vx = 



[ 1 ] 


if a probability coefficient is desired, or in 


nil 

Vn == —7= e 
'S/r 


~A2a;2 



if a frequency distribution is desired. In calculating h and the precision 
indexes where n is small, we may conveniently use Eqs. 6 to 9 as they 
stand. Usually, however, will involve lengthy computations, espe- 
cially if X is carried out to more significant figures than are contained 
in the original X-readings. Hence, the use of some short method such 
as that of the following section is advisable as a time saver and as an 
aid in eliminating computational errors. 

3. A Short Method of Computing Means and Precision Indexes, 
To find the mean and a, say, of the measurements Xi, X^,* • -X^, we 
first assume an approximate mean, X', having a convenient rounded 
value near that of the true mean, and then deal with the differences 


responding equations relating to the more impo rtant precision indexes of means are 
kept simpler. Instead of involving Vn(n — 1), the simpler relations involve n only. 
The second reason is that in practice seldom, if ever, as will be indicated later in this 
chapter, are truly normal frequency distributions encountered, even in the infinite 
parent groups. At the best, then, the precision indexes sought can only be approxi- 
mations, and it appears that in reality the expressions involving n only may be 
significant as those involving Vn(n — 1) instead. The third reason is that even 
for parent groups whose distributions approximate the normal very closely, the 
uncertainties in the precision indexes themselves often exceed the assumed error due 
to approximating {n — l)/nby unity. 

Nevertheless, for the sake of those who differ, the authors will attempt, through- 
out this book, to make reference to this footnote wherever the above simplification 
has been made. 
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Xi — X', X 2 — XV "Xn — X'. The associated numerics are usually 
small and more or less evenly di\dded between positive and negative 
values. Procedure is based on the following basic relations: 


= ^ - ^ 0 ] ^ ^ 
n n 




= X' + A [11] 


and 


= 


^ -X' - aY 

n n n 


2(X - XQ^ - 2AE(X ~ XQ + nA^ 
n 


S(X - X'Y 
n 


S(X ~ XQ ]^ 
n 


S(X ~ XQ^ 
n 


[ 12 ] 


The necessary computations, together with a check to be discussed later, 
are carried through in Table 1. To one who has done much computing, 
the smallness of the numbers dealt mth makes a considerable appeal. 

Where computed results are matters of concern, it is desirable to have 
checks as insurance against errors. There are two checks possible for 
the mean, X. One consists in determining actual values for the devia- 
tions X — X and then noting whether or not the s um of the positive 
deviations equals the sum of the negative deviations. The other con- 
sists in selecting a new X' and proceeding according to Eq. 11, taking 
care not to use computations made use of in the original calculation. 
The second method is likely to be the shorter if the value of the mean 
is carried to a greater number of significant figures than the original 
measured values. Neither of these checks need be made in case one 
has determined the cr and wishes to insure against error there also, since 
certain checks for cr involve a simultaneous check for X. 

Two procedures for checking a will be cited. One is based on the 
defining relation, Eq. 12, which by simple expansion yields 


2 _ S(X - X)^ _ sx^ 
n n 


2XSX , _ 2X^ 

1- X^ = 

n n 




[13] 


This equation does not involve summations previously made, and there- 
fore can satisfy as a check. The summation SX^ will, however, gener- 
ally involve uncomfortably large numbers. Procedure for the second 
check consists in selecting a new convenient X' and proceeding as in 
Eq. 12. This method, which is illustrated in Table I, is likely to prove 
much the shorter. The reader who doubts this assertion is invited to 
make the test, using Eq. 13. 
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When calculating o- for a set of positive and negative values whose 
mean is nearly zero, the advantages of using Eq. 12 rather than Eq. I3 
generally disappear. Note that if X' is taken as zero Eqs. 12 and 13 
become identical, so that only the second of the two checks for <t men- 
tioned above can be used. 


TABLE I 


Illtjstkatinq a Shoet Method foe Computing X and or, Together with a 
Convenient Check. The Frequency of Occurrence of the Observed Values 

OF X IS Given by / 


X 

f 

X' = 128 

X' = 129 

X-X' 

fix - X') 

fix - X'? 

X-X' 

fix - T) 

fix - X? 

125 

2 

-3 

-6 

18 

-4 

-8 

32 

126 

3 

-2 

-6 

12 

-3 

-9 

27 

127 

9 

--1 

-9 

9 

-2 

-18 

36 

128 

15 

0 

0 

0 

-1 

-15 

15 

129 

11 , 

1 

11 

11 

0 

0 

0 

130 

7 

2 

14 

28 

1 

7 

7 

131 

2 

3 

6 

18 

2 

4 

8 

132 

1 

4 

4 

16 

3 

3 

9 


50 


14 

112 


-36 

134 



A = -^ = 0.28 


A = 

-M = -0.72 



X = 128 4- 0.28 ^ 

= 128.28 

X = 129 - 0.72 = 

= 128,28 



0^ = - (0.28)“ = 2.16 

= W - (0-72)“ = 2.16, 



<r = 1.47 


0- = 1.47 




p - 0.676 X 1.47 = 0.99 

p = 0.676 X 1.47 = 0.99 


Accepted values: X = 128.3; <r = 1.5; p = 1.0. 


4. Chauvenet’s Criterion. Occasionally, in a series of readings, one 
or two values occur which differ considerably from the series as a whole. 
Though we might normally expect such widely divergent values tq occur 
once, say, on the average in 100 readings, it is quite possible for that 
once to occur in a group of 10 or of only 5 measurements. In such a 
case, the influence of this divergent reading on the magnitude of the 
mean is disproportionately large, and it is generally conceded that the 
mean obtained would be closer to the true value if this reading were 
rejected. There is no suggestion in the criterion that a gross error has 
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been made in taking a reading whicb it rejects, although, it is yery pos- 
sible that such is the explanation for the deviation. 

Rejection of a given reading of a series on the basis of a hunch is not 
satisfactory, and a criterion of rejection is desirable. Of the several 
which have been developed, that due to Chauvenet seems most gener- 
ally accepted. In words, this criterion states that any reading of a 
series of n readings shall be rejected when the magnitude of its devia- 
tion from the mean of the series is such that the probability of occur- 
rence of all deviations that large or larger does not exceed l/2n. Ex- 
pressed partly in equation form, it states that if the deviation x of a 
reading from the mean is greater than the deviation x, where x is de- 
fined by 



the reading shall be rejected. To illustrate, in a series of ten readings 
whose probable error is 0.477/Aa;), a reading shall be rejected if 
its deviation from the mean is greater than 2.91pa; (see Table III, Appen- 
dix 2). The probability of occurrence of aU deviations as great or 
greater is then less than 1/20. For 20 readings, the value of x is ZZ2px* 
The variation of x with n is shown in Table III, Appendix 2. 

If, after a reading has been rejected in accordance with Chauvenet ^s 
criterion, it is felt that a second reading is also too divergent to retain, 
it too should be subjected to the criterion, with the xmderstanding that 
the reading already rejected is no longer a member of the series and the 
new mean concerns the n — 1 remaining measurements. This pro- 
cedure may be repeated until it is found that no values lie outside the 
limits set by Eq. 14. 

5. Limitations of the Normal Law. It is blindly assumed by many 
that the vast majority of frequency distributions obey the normal law. 
There are many reasons why such should not be the case. We shall 
discuss certain of them in some detail. 

1. The normal distribution is symmetrical — equal positive and 
negative deviations between limits from the mean are equally likely 
to occur. Few observed distributions are perfectly symmetrical, how- 
ever, and numerous distributions show a decided preponderance of 
values either greater or less than the mean (Fig. 1). Such distribu- 
tions are called skewed— negatively if the majority of the observa- 
tions exceed the mean, and positively for the opposite condition. 

2. The normal law permits variations from —oo to ; i‘e., it 
assigns a probability ^eater than 2 ;ero to every finite deviation from 
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the mean. Hence, such distributions as that of the speeds of mole- 
cules of a gas at a given temperature (Fig. 1) cannot be represented 
by the normal law since it is meaningless to speak of negative speeds 



Fig. 1. The non-normal distribution of the speeds of oxygen molecules at 0° C. 


3. The normal curve has only one maximum ordinate, at the mean 
value. Some distributions, however, have more than one maximum 
(Fig. 2) and cannot be normal. 

4. Let us assume, despite the three limitations stated, that a par- 
ticular distribution, say that of the diameters, d, of a group of bearing 



Fig. 2. A non-normal distribution with more than one maximum ordinate, showing 
the probability of finding a pendulum bob at different displacements from its equi- 
librium position for a given amplitude of vibration. (University of Pittsburgh 
Atomic Physics, 2nd Ed., p. 165, New York, John Wiley & Sons, Inc., 1937.) 

balls, obeys the normal law, at least to the extent of the balls whose 
diameters fall between d + Spd and d — hpd^ Then it necessarily 
follows that if all the balls are truly spherical and of equal density, 




LIMITATIONS OF THE NORMAL LAW 


173 


the distributions of their masses, i.e., of the (d^) of the bearing balls 
cannot obey the law. Consider three hypothetical balls, J., and 
C, with diameters equal to the mean diameter, 5, the mean diameter 
minus the probable error of the distribution, d — pd, and the mean 
diameter plus the probable error, i + pd, respectively (Fig. 3A). 
Since the diameter distribution of the group of balls is assumed 
normal, A, B, and C di^dde them into four equal subgroups — those 
having diameters less than B, those having diameters between A and 
B, etc. Assuming equal density and truly spherical shape for all, A, 
Bj and C again divide them into the same four equal subgroups on 



Fig. 3. Distributions of (A) the diameters and (B) the masses of a group of bearing 
balls. If A is assumed normal, B is necessarily skewed. 


the basis of mass also; i.e., all balls having diameters less than B also 
have masses less than B, etc. Hence, if the mass distribution is to 
be normal, ball A should have the mean mass, and B and C should 
have masses respectively less than and greater than the mean by an 
amount equal to the probable error of the mass distribution. How- 
ever, the masses of A, Bj and C are b(d — Pd)^j and b{d + pd)^ , 
respectively, where b is an appropriate constant, and it is seen that 
the mass difference between A and B is not equal to the mass differ- 
ence between A and C (Fig. 3B). Thus, if the diameter distribution 
is normal, the mass distribution is skewed and hence nonnormal. 

By similar reasoning it is seen that distributions of the surface areas 
involving the moments of inertia involving d^, the values of 1/d, 
1/d^, etc., for the group are also nonnormal if the d-distribution is as- 
sumed normal. Since the a priori probability of normality for the dis- 
tribution of d is equal to that for d^, d^, d^, etc., the probability of 
any one obeying the normal law strictly is effectively zero. 

Further evidence as to the nonuniversality of the normal law even 
for ordinary distributions is furnished by the large number of statistical 
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distribution laws in use for different purposes. Fry ^ lists eight types 
some of which cover several subtypes. Those named in addition to the 
Normal law are the Poisson law, the Binomial law, Pearson Types I 
II, III, and IV, and the Gram Charlier series. 

As such nonnormal distributions of considerable interest in present- 
day research, we have the Poisson distribution, its integral, and its 
derivative. The equation for the law itself is 



[15] 


of which Pn,z represents, for a random distribution of events in a lim- 
ited range of the variable x, the probability that n events will occur in 
the interval rc, a the average interval of x between events, and accord- 
ingly x/a the expected number of events in the interval x. For the 
case of = 0, or no events occurring in the interval, Eq. 15 reduces to 

Po,xdx = [16] 

and, the rate of change of Pq,x with respect to x, to 


dP o,x 
dx 



a 



For the probability, however, that n or more events will occur in the 
interval x, P>n,z) we have the summation 


P>n,x ^ ^ PrntX [18] 

m—n 

The last equation represents, for example, the probability distribution 
of concern when one tries to correlate the visual responses with the^ 
quanta of radiant energy that are absorbed by the visual fluid of the 
retina during brief flashes of light received by the eye. It has been 
used by Hecht ^ and his co-workers in a study of the operation of visual 
mechanisms at the threshold of vision. (See Fig. 14, Chap. II.) 

Similarly, -dPo,x/dx of Eq. 17 represents, for the emission of 
a-particles from a radioactive specimen, for example, the frequency dis- 
tribution for time intervals between successive a-particle emissions. 
Fig. 4 represents data of this nature obtained by Halliday.^ Offhand, 

^ Fry, Thornton C., Prohahility and Its Engineering Usesy New York, D. Van 
Nostrand Company, Inc., 19^8. 

2 Hecht, S., Shaler, S., Pirenne, M. lEL., Science^ 93, 585 (1941). 

®HaUiday, D., Ph.D. thesis, University of Pittsburgh, 1941. 
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on the mere basis of randomness, one might be inclined to assume that 
the normal frequency distribution or a close approximation to it would 
apply there. Such, however, is far from the case. 



Pulse Interval in Sec. 


Fig. 4. The Poisson distribution of Eq. 17 as represented by the frequency distri- 
bution of time intervals between successive receptions of o-particles from a radio- 
active source, as obtained by D. Halliday, who measured 3133 pulse intervals. 
The horizontal portions of the broken line represent observed probabilities for 
half-second intervals expr^ed in terms of reciprocal seconds. The unbroken line 
represents the expectation according to Eq. 17 for a mean interval of 1-169 sec. 

6. Justification for Assuming the Normal Law. In view of the above 
limitations, one must consider a new situation carefully before ever 
assuming that the normal distribution law applies to a series of measured 
values that has-been obtained. But now, having concluded in a partic- 
ular case that the normal distribution law or a close approximation is 
reasonable, what shall be done? Let us examine more closely what is 
meant by the statement that the normal law governs a given distribu- 
tion. We mean by this statement that as the number of observations 
included in the sample distribution increases, the probabilities of occur- 
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rence of deviations from the mean approach ever more closely the values 
predicted by Eq. 1. An actual sample distribution with a finite number 
of observations never indicates such predicted probabilities. Instead 
it may be quite skewed, or even two-peaked, and still the infinite parent 
distribution might conform with the normal law. In such cases the 
deviations from normality would disappear if it were possible or prac- 
tical to add a sufficiently great number of values. 

Referring to limitation 1 above, a distribution of a finite number of 
readings need not be perfectly symmetrical to be considered normal. 



.68 .70 .72 .74 .76 


Wavelength in Angstroms 

Fia. 5. The Compton effect, an illustration of a two-maximum distribution result- 
ing from the inclusions pf two physically separate, but not separated, photon 
distributions. Graph shows unmodified, P, and shifted, S, Mo Ka radiation 
scattered by carbon. (Compton, A, H., Phys. Rev., 21, 715, and 22, 409, 1923.) 

Conversely, it is admitted that fhe infinite parent distribution corre- 
sponding to an observed apparently normal distribution may be non- 
normal. The same argument applies to limitation 4. It happens, 
especially when the precision indexes are relatively small, that the 
distributions of such related things as the diameters, areas, masses, etc., 
of a group of bearing balls say, may all be effectively normal, even 
though each distribution is somewhat skewed, and even though only 
one of the related infinite parent distributions can possibly be normal, 
even for a restricted range. 

Limitation 3 is not an important one, since relatively few distributions 
have more than one maximum ordinate, and, as stated above, some 
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two-peaked distributions may actually be samples from infinite parent 
distributions that are normal. However, when the parent distribution 
follows a nonnormal law, proper tests, such as the chi-square test to be 
discussed later, may disclose this fact and thus prevent drawing false 
conclusions by assuming normality. It is interesting that in some cases 
two maxima are obtained as a result of the inclusion in a single distri- 
bution of two sets of dissimilar values, each of which yields a distribu- 
tion with one peak normally when taken alone (Fig. 5). 

Despite its limitations, the normal law, in addition to being capable 
of representing distributions that are believed to be normal, is also 
capable of representing sufficiently weU many distributions which, from 
a priori consideration, are known to be nonnormal. Adding to this the 
fact that the normal cur\"e is the simplest to fit, we feel justified in adopt- 
ing the normal law where skewness, flatness, and other characteristics 
do not cause too serious deviations from the normal distribution. 

At any rate, for one reason or another, it is customary to assume 
that the measurements of a quantity follow the normal distribution 
law when the least count is small in comparison with the variations from 
the mean and the distribution is not too obviously nonnormal. On this 
basis, a considerable superstructure of treatment of data has been 
foimded, including that in the succeeding chapters of this book. 

7* Qualitative Tests for the Normal Distribution. Tests for applica- 
bility of the normal law may be classed as either quantitative or quali- 
tative. The former are the more definite in their interpretations, but 
they are rather involved and tedious to carry through. The qualitative 
tests are simple, but often difficult to interpret. They are of value, 
however, in exposing distributions which deviate greatl}’' from the 
normal. Two tests will be described: (1) superposing the normal curve, 
and (2) plotting on probability paper. 

(a) Superposing the Normal Curve. A good idea of the normality of 
a distribution may be obtained by superposing on the graph of observed 
values the computed normal distribution which best fits. For the 
demonstration of how this may be done, we use data by Birge.^ See 
Table II and Fig, 6. 

Normal procedure, described earlier in this chapter, leads to 

= 3.60 X mil [19] 

f = 5.09 X 10^^ mil [20] 

h 

^ Birge, R. J., Phys. Tteo.^ 40, 207 (1932). The data of the table were reported to 
the authors by private correspondence. 
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and for the 500 observations 


Vn = 500 residuals X Px = 55*4 


residuals 

10“^ m/i 


Q.Q386 


[ 21 ] 


TABLE II 

Data by Birqe ^ Showing, for 500 Observations of a Spectral Line, the 
Frequency op Occurrence op Various Residuals, x 


By chance the mean was such that all residuals could be expressed precisely in terms 
of a tenth of the least count, 0.0010 m/x, of his instrument. 


Observed 

Computed 

X in 

No. of 

X in' 

No. of 



X in 

2 /nin 


residuals 

TClfM 

residuals 

fhS/ 

Vhx 

10*“^ mil 

1 esiciuais 

10-3 

+0.1 

62 

~ 0.9 

53 

0.0 

0.5642 

0.00 

55.4 

1.1 

41 

-- 1.9 

52 

0.2 

.5420 

1.02 

53.2 

■ 2.1 

45 

- 2.9 

30 

0.4 

.4808 

2.04 

47.2 

3.1 

44 

- 3.9 

31 

0.6 

.3936 

3.06 

38.6 

4.1 

34 

- 4.9 

22 

0.8 

.2975 

4.07 

29.2 

5.1 

20 

- 5.9 

21 

1.0 

.2076 

5.09 

20.4 

6.1 

16 

- 6.9 

11 

1.2 

.1336 

6.11 

13.1 

7.1 

3 

- 7.9 

1 

1.4 

.0794 

7.13 

7.8 

8.1 

4 

- 8.9 

4 

1.6 

.0436 

8.14 

4.3 

9.1 

3 

- 9.9 

1 

1.8 

.0221 

9.16 

2.2 

10.1 

1 

-10.9 

0 

2.0 

.0104 

10.18 

1.0 

11.1 

1 

-11.9 

0 

2.2 

.0044 

11.20 

0.4 


Continuing, we may compute values directly, using Eq. 21 or make 
use of Table I of Appendix 2, for whose use residuals must be expressed 
in terms of 1/h or as hx. For hx = 1, i.e., for x equal to 1/h or 5.09 X 
10"~^ m/i, we obtain for the relative probability coefficient, yux, the value 
0.2076. From this in accord with Eq. 22 of Chapter VI, namely 

d(hx) ' ^ ^ 

1/x Phx ^ — ^Vhx [22] 

we obtain, as a corresponding value for 


Vn = nya, = 


500, residuals 


5.09 X mix 


0.2076 


^ residuals ^ 

= 98.2— g 0.2076 

10 ^ mix 


20.4 


residuals 


[23] 


I Idem. 


10 ^ m/i 
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This value plotted in Fig. 6 at a; = +5.09 X 10'“^ m/i and x - -5,09 
X 10“^ m/z ^delds two points of the desired superposed normal frequene^^ 
curve for that graph. Other points may be obtained by seeking simi- 
larly (the last half of Table II) values of yhx corresponding to hx values, 
such as 0.0, 0.2, 0.4* ••1.2, 1.4, etc. In all cases the factor 98.2 
residuals/10~^ m/z serves in obtaining the appropriate 2/n- 
That the superposed curv^e of Fig. 6 fits well is e\ddent. The ensemble 
of data, as shown by figure and data, is thought, in comparison with 



-12 -8 -4 0 4 8 12 

Residuals, x, in 10 ^ 


Fig. 6. Graph showing the frequency distribution of the residuals for 500 observa- 
tions of a spectral line as obtained by Birge (Table II), and the superposition of the 
best fitting normal frequency curve. 


other experimental data, to conform to an unusually high degree with 
the normal distribution curve, 

(6) Plotting the Ogive Curve. An alternate method of plotting a distri- 
bution curve, Galton's ogive curve, is shown in Fig. 7. In this curve, 
the number (or percentage) of occurrences of magnitudes either less or 
greater than x is shown as a function of x. Plotting the normal curve in 
this manner would be equivalent to plotting, as a function of x, the 
integral Fi, where 



or, of course, F 2 where 
Y2 



[ 25 ] 
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Distribution data, however, are frequently presented in the form of 
finite values of A F to correspond to finite increments of x, Ax, which 
are usually constant throughout. We then use the summations 


Yin [26] 

and 

N 

Y2n = ^ Vm [ 27 ] 



-12 “8 « 0 4 Q 12 

Residuals, in 10 ^ of Measurements of a 
Wavelength from the Mean 


Fig. 7. Galton’s ogive curve for the distribution of Table 11. All of the plotted 
points should be shifted to the right by 0.5 X m/x. 


in which Fi„ and Yzn represent numbers of readings. They are usually 
plotted as functions of Xm, or mAx. Often in tabulations, the values 
listed for the independent variable are central values for the succeeding 
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least-count intervals. To secure passage of the curve through the zero- 
residual 50%-frequency point for a normal distribution, Yin and Y 2 n 
may be plotted as functions of a; + Ax/2 and x — Ax/2. 

Though the ogive curve possesses some advantages, it is hardly suit- 



Residuals, in 10 ' mp., of Measurements of a Wavelength from the Mean 

Fig. 8. Graph of frequency distribution of Table II plotted on probability paper. 
AU of the plotted points should be shifted to the right by 0.5 X 10~^ mfi. 

able as a test for normality, since generally departures from normalit 3 ^ 
are concealed rather than exposed. If, however, the data are plotted 
on so-called probability paper rather than on rectangular coordinate 
paper, the resultant curve possesses aU the advantages of the ogive curve 
and in addition provides a convenient test for normality. 

On probability paper the scale showing the number of occurrences, 
expressed as a percentage of the total number of occurrences, is dis- 
torted so that the distances from 50% to aU other percentages are 
proportional to the corresponding values of x/u. The scale is sym- 
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metrical about the 50% coordinate line, and the integrals Yi and Y 2 
or the summations Fin and Fgn, iii- case the data follow the noimal dis- 
tribution law, plotted as functions of x on such coordinates yield straight 
lines. Hence, a plot showing the relative numbers of observations hav- 
ing values less than (or greater than) x, as a function of x, will deviate 
from a straight line if the distribution deviates from the normal. Fig. 8 
shows the application of this test for normality to the data of Table 11. 
Deviations from normality are revealed though perhaps not as clearly 
as in Fig. 6. However, insofar as ease and time of construction are 
concerned, this method of testing is much the superior. 

8. Quantitative Tests for Deviations from Assumed Distributions. 
When a distribution of data is believed, for theoretical reasons or other- 
wise, to follow some recognized law of which there are many, it may be 
judged by its closeness of fit to an equation following that law. Often, 
however, many distributions are without theoretical or even empirical 
backing. Then particularly the deviation from an assumed normal dis- 
tribution may be sought. There are two tests known as skewness, 
represented in magnitude by flatness, represented in magni- 

tude by which are used to indicate deviations from the normal fre- 
quency curve. One test, the chi square, may be used whatever the 
distribution. The chi-square test is much more important and much 
more used than the other tests. 

Skewness, or asymmetry with respect to the distribution about the 
mean of the observed values, obviously cannot be revealed by the sum 
of the deviations from the mean, for that is zero by definition, nor by 
the sum of the squares of such deviations or of such deviations raised 
to an even power since in such squares or even powers there are no 
distinctions between positive and negative deviations. The sums of 
odd powers, however, do make such distinctions and will indicate asym- 
metries. Arbitrarily, the sum of the third powers of deviations expressed 
in terms of the standard deviation 0 * in each instance is used. The 
defining equation used is 


vft —3 


[28] 


In case the data are represented by a curve which has been drawn, the 
following equation may be used instead. 


Vfi = 



[29] 
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Obviously is zero for a strictly normal distribution. How signifi- 
cant any particular computed value may be is only comprehended by 
determining values for various asymmetric distributions. That for the 
distribution of Table I is +0.013 ; that for the molecular speeds of the 
molecules of a gas (Fig. 1) is about 21. 

Flatness, the distortion represented in Fig. 9, on the other hand ob- 
viously cannot be represented quantitatively by any odd power summa- 
tion. Nor will a second power summation of deviations expressed in 
terms of the standard de\dation suflbce since when so expressed all such 
summations, however flat or skewed, yield a by definition. A fourth 
power summation vill nevertheless show 



for graphed data. 

For a normal distribution is 3. Evidently distributions may be 
more flat or less flat than that which is normal. Owing to the increased 
effectiveness of large values of y accompanying large values for x in 
yielding large values for a fourth power summation, it is evident that 
the ^2 for curve B of Fig. 9 will be less than 3. 

Differing, as already noted from the two tests just described, the 
chi-square test may be applied to determine the deviation of an actual 
distribution from any assumed law for the infinite parent distribution. 
In this case, one considers the probability that a random sample, taken 
from the infinite parent, shall differ from the assumed law by the amount 
found. Though some prefer 0.05 as the limiting probability, it is gen- 
erally held that a sample is satisfactory if the probability of its occur- 
rence is 0.01 or greater. 

The function as defined by Pearson, the originator of the test, is 
based on a comparison of observed, /o, with expected, /c, frequencies of 
oceutrence of individual readings, and is given by 
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In the application of Eq. 32, it is usual to array the observed measure- 
ments in groups, to each of which a certain specified range is assigned. 
Thus arranged, the number included in any one group is taken as the 
observed frequency of occurrence for the corresponding group range. 
The ranges for the various groups of a distribution need not be the sanae. 

Once has been obtained for a particular set of data, it remains to 
determine what the probability of its occurrence shall be. For this 



Fig. 10. Showing chi-square probability, for goodness of fit of a sample dis- 
tribution as a function of and of n', the number of groups of data less the number 
of imposed conditions. 


purpose Pearson ^ has computed extended tables of probability of occur- 
rence, which depend not only on x^ but also on n', the number of groups 
selected less the number of imposed conditions.^ One imposed condition 
is that the total number of items entering x^ must equal the number 
entering the various groups. Other conditions sometimes imposed are 
those ascribing to the infinite parent a distribution described by con- 
stants, in the normal case, the X and <r determined from the sample. In 
this case n' becomes three less than the number of groups. Sometimes 
still other conditions are specified and should be taken into account. A 
graph giving chi-square probabilities as a function of x^ and n' is given 

^ Pearson, K., Trans. Arn. Math. Soc., 31 , 133 (1929). 

^ Fry, Thornton C., Probability and Its PJngineeriny Uses, p. 294, New York, 
D. Van Nostrand Company, Inc., 1928. 
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in Fig. 10. (See also Table IV of Appendix 2.) Application to the velocity 
of light measurements of Michelson, Pease, and Pearson ^ is shown in 
Table III. On the assumption that the infinite parent distribution is 

TABLE III 

Application of the Chi-Square Test to the Velocity of Light 
Measurements of Michelson, Pease, and Pearson 

From 233 deterininatioiis a weighted average velocity of light of 299,773.85 km/sec 
was obtained; c' represents the excess of a measured velocity over 299,000 km/sec- 
A frequency, fo, for a specified range represents the number of determinations 
falling jwdthin the range, and fc represents the number expected on the basis of the 
given X and of a o- of 14.7 km/sec. (The present authors are greatly indebted to 
Dr. E. Q. Adams who pointed out that the procedure of the first printing, wherein 
fo was taken as a sum of weights, was in error, and who has supplied the material 
here presented). 


Range of c* 
in km/sec. 

fo 

fo ' 

ifc ■“ fo) 

(fo-foY 

fc 

<741 

741-45 

46-50 

51-55 

56-60 

61-65 

66-70 

71-75 

76-80 

81-85 

86-90 

91-95 

96-00 

801-05 

06-10 

>810 

7[l4 

4j 

8 

17 

23 

29 

45 

40 

17 

16 

10 

51 

2 14 

4) 

2.25] 

3.04 [ 11. 24 
5.95] 

10.42 

16.24 

22.60 

28.06 

31.09 

30.73 

27.11 

21.37 

14.99 

9.39] 

^•^^19 14 
1.861 

- 0.75) 

- a.96[-2.76 

+ I. 95 J 

+ 2.42 

- 0.76 

- 0-40 

- 0.94 
-13.91 

- 9.27 
+10.11 
+ 5.37 
+ 4.99 
+ 4.39] 

- 2 . 14 ] 

0.25) 

5.151 0.68 
0.64) 

0.56 

0.04 

0.01 

0.03 

6.23 

2.80 

3,78 

1.35 

1.66 

2.06 

1 38 

0.05 

2.46. 

233 

233 

x2-= 29.10 18.52 


For = 29.10 and n = 13, = 0.005. For = 18.52 and n' 8, Pr = 0.018. 


normal, the value computed for indicates a rather small probability, 
0.005, that another similar set taken at random would deviate as much 
or more from a normal distribution. However, if the grouping, which 
is entirely arbitrary, is changed by collecting the three lowest and the 
four highest groups of the table into two larger groups, as indicated by 
1 Michelson, A. A., Pease, F. G., Pearson, F., Astraphys, J., 82, 56 (1935). 
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the brackets, a recognized procedure where the of adjacent groups 
are small, the computed value for Py 2 is larger, about 0.018. On the 
other hand, Fig. 11, in which summations of weights rather than num- 
bers of determinations are graphed, suggests that these low pi'obabilities 
may indicate that the present distribution has a flatness (kurtosis), /Jg, 
less than 3, as has Pearsons^ Type VII distribution. Obviously, these 
measurements are much less normally distributed than are Birgers spec- 
tral line measurements. (Fig. 6 and Table II.) 



Measured Velocities of Light in km /sec in Excess of 299,000 kroysec 


Fig. 11. Diathbution of measurements of the velocity of light made by Michelson, 
Pease, and Pearson (see Table III) grouped for velocity intervals of 5 km /sec. 
The broken line represents actual measurements. The smooth curve represents 
the distribution expected had the measurements followed the normal law. 


9. Summary. The methods for the quantitative evaluations of A, 
O', p, and a are described in Eqs. 6 to 9. 

A short method for computing a mean X and the precision index 0 
for a set of n readings consists in assuming an approximate mean, X/ 
and then applying the two following equations: 


+ 


2(X - T) 
n 


[ 11 ] 



Chauvenet^s criterion, intended to eliminate from a set of readings 
the effect due to single readings exerting unduly large effects on the means, 
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states that a reading should be rejected when it yields a deviation from 
the mean such that the probability of occurrenee of deviations of that 
magnitude and greater is less than l/27i, where n is the number of 
readings. With x as the limiting minimum de\dation for rejection, the 
criterion takes the form 

l-Pi=l-4= = L [14] 

V X J -X 

The limitation of the normal distribution law is discussed in some 
detail, but it is indicated that it is customary to assume that most sets 
of measurements follow that law and that a considerable superstructure 
of precision treatment of data has been built upon it. 

Qualitative and quantitative tests for the goodness of fit of the normal 
distribution law are described. These included (1) superposing the best 
normal distribution curve, (2) plotting the ogive cun^e on ordinary cross- 
section and on probability paper, (3) computing skewmess and flatness, 
and (4) applying the chi-square test. Chi square, x^j is given by 

[32] 

of which /o and/c are observed and expected frequencies of occurrence 
of values as grouped about arbitrarily chosen mean values. With x^ 
computed, one seeks, from a table or from Fig. 10, a probabUity of occur- 
rence, of the given set of readings as a function of x^ and n' the 
number of groups of readings less the number of imposed conditions. A 
Py 2 of 0.01 or more is usually considered satisfactory as a probability. 

PROBLEMS 

1. Find approximate values of p, o, cr, and 1/h for the data of Fig. 1, Chapter VI. 

2. Given that the times recorded by 36 observers as the interval for a certain 
phenomenon were distributed as follows: 

3 observers recorded 32.0 sec 
7 “ “ 32.2 “ 

12 “ 32.3 “ 

6 “ 32.4 “ 

6 “ “ 32.5 “ 

1 « 32.6 

1 “ 33.0 “ 

Compute the mean, p, a, <r, and 1/h, Should the last recorded observation be 
eliminated? 

3. Plot the data of Problem 2 and draw on the same sheet the curve of the normal 
distribution law which has the same modulus of precision a^ that computed from the 
data. 
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4. Given that the distribution of diameters, D, about their mean, Do, for a set of 
bearing balls, all of the same density, is 


Vd 


VJ 


show that the distribution of their volumes, 7, about the volume, Fo of a ball whose 
diameter is Do is given to a first approximation by 



27-Fo\ 


of which kyis defined by 


hy 


2 

^97ryo^ 


hD 


6. Plot curves like those of Figs. 6, 7, and 8 to represent the distribution of data 
given in Table I. What is your conclusion regarding the sensitivity of the various 
methods of plotting in showing variations of distribution curves from normal? 

6. The mean annual temperatures of Pittsburgh reported by the U. S. Weather 
Bureau for the 71 years, 1872-1942, are 


Ranges of Mean Annual Temperature ‘ 
in T 

48.8- 49.2 

49.3- 49.7 

49.8- 50.2 

50.3- 50.7 

50.8- 51.2 

51.3- 51.7 

51.8- 52.2 

52.3- 52.7 

52.8- 53.2 

53.3- 53.7 

53.8- 54.2 

54.3- 54.7 

54.8- 55.2 

55.3- 55.7 


Number of Years of Occurrence of 
Means Within the Specified Ranges 
1 
2 
1 
3 
6 
8 
8 
9 
10 
10 
7 
6 
0 
1 


Make graphs of the data similar to those of Figs. 6 and 7. Determine values for the 
mean annual temperature and for p, cr, and l/h. Judged from the distribution given, 
what is the probability that the mean temperature of Pittsburgh for the coming year 
will fall between 49.5° F and 50.5° F? What are the limits of the smallest range of 
temperature within which that temperature has a 50% chance of occurring? 

7. Using Fig. 10 and Birge’s data as recorded in Table 11, determine the values of 
O' and Px^ which apply. Choose the limits for the various frequency ranges such 
that at least 10 residuals will be included within each range. 
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MEANS AND PRECISION INDEXES OF UNEQUALLY 
WEIGHTED MEASUREMENTS 

1. Introduction. In the preceding chapter, we derived expressions 
for the precision indexes, {ljh)x, ff*, Ox, and px, of a single X-reading 
chosen at random from a series of equally precise readings assumed to 
obey the normal distribution law. We found, among other things, that 
these indexes teU us the likelihood that a single reading will deviate 
from the mean of the series by a certain amount. Granted this, it now 
becomes desirable to know the precision inde.xes of the mean itself, i.e., 
the likelihood that the mean will deviate by a certain amount from the 
so-caUed grand mean, the mean of a series of similarly determined means. 
To know that an individual reading of a specified length has a probable 
error of 0.05 mm is worth while; to know that the mean of a series of 
length readings has a probable error of 0.002 mm is generally more 
important. 

Some readings of a series may, because of conditions, be more reliable 
than others. It is then customary to assign weights to the individual 
readings. Usually such assigned w^eights are arbitrary, though not 
without reason. Often the assignments are in accord with some plan. 
If one reading is considered, roughly speaking, twice as reliable as a 
second, respective weights having the ratio 2 ; 1 may be assigned; 
e.g., weights of 4 and 2, ot of 1 and etc. For a group of such read- 
ings, as for one of equally reliable readings, it is desirable to obtain the 
most probable mean and its precision indexes. 

In this chapter we first derive an expression for the mean of a series 
of weighted measurements. The precision indexes of the individual 
weighted readings are then obtained, and their relationship to the arbi- 
trary weights is pointed, out. We next consider the mean, whether 
obtained from equally or unequally weighted readings, as a particular 
kind of wei^ted reading, and derive its precision indexes. A short 
method for computing means and precision indexes from unequally 
weighted readings is then presented. Finally, we consider the problem 
of combining several mean values of a quantity into a grand mean and 
its precision indexes, first for the ease where the intermediate means 
are consistent, and then for the case where they are inconsistent. 

189 
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2. The Mean of Weighted Single Observations of a Quantity. In 

what follows, we assume that a reading Xi having a weight wi is equiva- 
lent to Wi readings of unit weight whose mean is Xi, This does not 
exclude fractional weights, since weights are only relative; the question 
of what might be meant by 0.1 reading of unit weight is irrelevant. 
As will be shown, it is important to recognize that these wi readings are 
not individually assumed equal to Xi and that only their average pos- 
sesses that value. 

Let Xi, X2,- * -Xn be a series of measurements having weights Wi, 
'^2, • • respectively. By our assumption, this series is equivalent to 

a particular series having (tyi + 'u;2 H Wn) readings of equal precision. 

The mean of this new series, and hence also of the unequally weighted 
series is evidently 

t 

^ ^ WiXi + * * WnXn ^ IjWX 

+ ^^2 H '^n ^ 

3. Precision Indexes of Weighted Single Observations. Let Xi, 
X2,‘-*Xn be a series of observations having known weights, Wi, 

• • • Wny but unknown moduli of precision, hi, h2, • • -hn- We again obtain 
an expression for the mean of this series, but this time by the method 
discussed on page 161 , making use of the variable pseudo-mean, X". 
As in Chapter VI, we seek the X" possessing a maximum probability 
of occurrence for the observed data. Assuming a normal distribution 
wherein rci, X2, * * * are the deviations from X" of Xi, X2, * • -X^, meas- 
urements having least counts of we have 

(A^P)i, 2 . 3 .. . .n = X X • • • 

= (^) <^'^1 ^ ^2 X • • (Arc)” [ 2 ] 

= a maximum 
or in logarithmic form 

In (A”P)i, 2 , 3 ... = -n In (v^) + S In A - (hiW+ • • • KW) 

+ n In (Arc) [3] 

= a naaximuna 

Differentiating with respect to X", we write 
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Since 


dxi 

dX" 


dX2 

dX" 


[5] 


we have as the condition for the maximum ^ probability of occurrence 
of the observations 

hi^Xi + h^X2~\- • * • hji^Xn = 0 [ 6 ] 

Representing the value of X", computed in accord with Eq. 6, by X, 
we write 

Xh^x = - X) = Xh^X - XXh^ = 0 [7] 

or 

X - rai 

^ “ -zjf 

Comparing Eqs. 1 and 8, remembering that the values of h are inde- 
pendent of each other, we find proportional to w, or 


h 

h2 


W2 


[9]' 


Wi 


[ 10 ] 


The relative precision indexes for the unequally weighted readings are 
therefore given by 

El = ^ . 

1 P 2 ^2 ^2 

^2 

The precision indexes of weighted single observations of a quantity vary 
inversely as the square roots of their weights. Letting h, a-, and p, in 
the further discussion, represent the moduli of precision for an observa- 
tion arbitrarily assumed to have unit weight, we obtain from Eq. 9 

1 


1 h 

hi 

[11] 


[12] 


[13] 


^ That Eq. 6 represents a maximum rather than a minimum is shown by the 
standard procedure of differentiating Eq. 4 to obtain c?/ (dX^O^i a quantity which is 
found to be essentially negative. 
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We may now assign absolute values to the precision indexes of the 
unequally weighted observations Xi, X 2 , ‘''Xn* We merely replace 
the various ¥s of Eq. 3 by their equals as- given by Eq. 11. There 
follow 

In (A”P)i ,2 . . . „ = i In " +n]nh- h^'Swx^ + » In (Ax) [14] 
= a maximum 

4 [In (A"P)i, 2 ,. . . J = ? - 2/iW = 0 [15] 

dh ’ ’ 




n 

21,wa^ 


[16] 


Hence, for the observation having unit weight, 


and 


1 _ j 2^x^ 
hx~ ^ n 




1 

^/2h 


4 


Xwx^ 


n 


px = 0.67<r 


= 0.67 a/? 


'Lwx^ 


n 


[ 17 ] ^ 

[18] ^ 
[19] 1 


By substitution in Eqs. 11 to 13^ similar expressions follow for the pre- 
cision indexes of other observations of different weight. Eqs. 17 to 19 
differ significantly from the corresponding expressions derived in Chapter 
VII for observations all of which are of equal weight. In place of the 
that one might offhand expect in the denominators of these equa- 
tions, theory shows the presence of n. This is the evidence for the 
caution given above when stating that a reading Xi with weight Wi is 
not equivalent to wi identical readings Xi all of unit weight. We may 
now illustrate the statement that reading Xi with weight Wi cannot be 
so considered. In Table I are presented three groups of readings. The 
first reading, 43, of group 1, with a weight of 5 is replaced in group 2, 
in accord with the faulty assumption, by five readings of 43, each with 
unit weight, and in group 3, in accord with the probable correct assump- 
tion, by five readings, each of unit weight, whose mean is 43. It is to 
be noted that these five vary among themselves to about the same ex- 
tent as the remaining five which are assumed throughout to have unit 
weight. It is seen that the computed values for <t for groups 1 and 2 
^ See footnote on page 167. 
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are necessarily different, whereas those for groups 1 and 3 are essentially 
alike, in conformity with what theory suggests. 

4. Precision Indexes of Means. If the reading Xi mth w'eight wi is 
equivalent to Wi readings whose mean is Xi, then the inverse is also 
true: n readings of unit weight whose mean is X are equivalent to a 

TABLE I 


Showing That a Reading Xi with Weight toi Is Not Equrv^AUENT to wi Read- 
ings Each Having the Value Xi 


Group 1 

Group 2 

Group 3 

X 

w 

X 

wx^ 

X 

w 

X 

9 

WX '‘ 

Z 

w 

X 

WOI ? 




\ 


[■43 

1 

0.5 

0.25 

40 

1 

2.5 

6.25 




1 


43 

1 

0.5 

0.25 

43 

1 

0.5 

0.25 

43 

5 

0.5 

1.25 ! 


43 

1 

0.5 

0.25 

45 

1 

2.5 

6.25 






43 

1 

0.5 

0.25 

44 

1 

1.5 

2.25 






Us 

1 

0.5 

0.25 

43 

1 

0.5 

0.25 

39 

1 

3.5 

12.25 

39 

1 

3.5 

12.25 

39 

1 

3.5 

12.25 

44 

1 1 

1,5 

2.25 

44 

1 

1.5 

2.25 

44 

1 

1.5 

2.25 

42 

1 1 

0.5 

0.25 

42 

1 

0.5 

0.25 

42 

1 

0.5 

0.25 

45 

1 

2.5 

6.25 

45 

1 

2.5 I 

6.25 

45 

1 

2.5 

6.25 

40 

1 

2.5 

6.25 

40 

1 

2.5 ' 

6.25 

; 40 

! 

1 

2.5 

6.25 


== 

= 28.50 




28.50 




42.50 



X = 

= 42.5 




42.5 




42.5 


ll^wx^ 

= <r = 

= 2.2 




1.7 




2.1 

\ 

1 n 












single reading X whose weight is n. Hence, in view of Eqs. 18 and 19, 
the precision indexes of a mean obtained from n equally weighted 
readings are given by 



[ 20 ] 1 



PX = 



0.67(rx = 0.67 




etc. 


‘ See footnote on page 167. 


[ 21 ] 


n 


[ 22 ] 
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where (lA)x, ox, etc., represent the precision indexes of an individual 
reading of unit weight. 

For a mean, obtained fron^unequally weighted readings, similar 
reasoning allows us to consider X as a single reading with the weight 
Sio. Hence for this case, 

ox 

\'ZiW 


4 


HiWX^ 

nZw 


[23] 


Px = 


0.67(rx 


= 0.67^J'■ 




etc. 


[24] 


The probable error of the mean, px, quantity which physicists 

generally accept as a measure of the accuracy of a reported result. It 
predicts that of a great number of similarly determined means, just 
one-half should normally deviate from the grand mean by an amount 
greater than px* 

With weights assigned according to Eq. 10, it usually happens that 
the numbers taken proportional to (1/p)^ turn out to be awkward. In 
such cases, one uses rounded values for the w^s with seldom more than 
two significant digits. For example, with pi : P 2 * Ps •* • * varying as 
3 : 40 : 8 :• • •, we might well use : W 2 : v)z :• • • varying as 1100 : 6 : 
160 :*-* rather than 1111.11:6.25:156.26. The departures from 
theory introduced thereby are not only very small but are quite justi- 
fiable in view of the general theory itself. 

5. A Short Method for Computing Means and Precision Indexes 
from Weighted Observations. Just as in equally precise measurements, 
much time and labor may be saved by using a short method for com- 
puting X, o-x, etc., for weighted measurements. Proceeding as on page 
168, selecting X' as a convenient approximate mean, and representing 


X — X' by A, we obtain 



X = X' + A = X' « 

, 7ki}(X-X') 

[25] 

and 


'Ew(X 

- zo' - 

[26] 


riEw 


The computations are conveniently carried through in tabular form 
as in Table II. As a check, the calculation of X and ax may be repeated, 
using a different value of X'. 

^ See footnote on page 167. 
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TABLE II 


iLIiXJSTBATING A ShOET MeTHOD FOR COMPUTING X AND CTJ FROM WEIGHTED DaTA, 
Together with a Convenient Check 


X 

/ 

H 

11 

to 

00 

X' = 129 

X-X' 



1 

X-X' 

1 

pu'x(X-f') 


125 

2 

2 

-3 

- 6 

18 

-4 

1 - 8 

32 

126 

3 

5 

-2 

-10 

20 

-3 

-15 

45 

127 

9 

18 

-1 

-18 

18 

-2 

1 -36 

72 

128 

15 

45 j 

0 

0 

0 

-1 

1 -45 

45 

129 

11 

35 

1 

35 

35 

0 

i 0 

0 

130 

7 

12 1 

2 

24 

48 

1 

12 

12 

131 

2 

2 ! 

3 

6 

18 

2 

4 

8 

132 

1 

1 

4 

4 

16 

3 

3 

9 


50 

120 

. i 


35 

173 


-85 

223 


A = — 9-29 

X == 128 + 0.29 = 128.29 
/l73 - 120(0.29)2 
50 X 120 

= 0.16 

p j = 0.67 X 0.16 = 0.11 






A = = -0-71 

X - 129 - 0.71 = 128.29 
[223 - 120( -0.71)2 
50 X 120 

= 0.16 
'PX = 0.11 






The data of Table II are those of Table I, page 170, with arbitrarily 
assigned weights. For the equally weighted data, X and cr^ are found 
to be 128.3 and 0.21. Comparing these with the values from Table 11, 
we note that the means are nearly identical but that the aj is appre- 
ciably smaller for the weighted data. This is a consequence of the 
arbitrarily greater weightings of measurements near the mean. 

6. The Grand Mean and Its Precision Indexes. The concept of a 
grand mean arises when one wishes to combine, for instance, various 
determinations of the velocity of light, c, such as Michelson made with 
8-sided, 12-sided, and 16-sided rotating mirrors of glass and of steel, in 
an attempt to determine the best value for c, and the probable error, pc- 
Let Xi, X 2 ,’ • -Xn be a set of intermediate means, corresponding in 
the above example to determinations of c made with (1) an 8-sided 
glass mirror, (2) a 12-sided steel mirror, etc. Let VXvVTv * * * VXn their 
probable errors. It is assumed that these intermediate means differ 
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because of accidental errors only. As has been shown, the weights of 
these means vary inversely as the squares of their probable errors, and 
we may assign to them the arbitrary weights h / px^ j k / px^ > ■ ■ ■ 
k^/px^, where ife is a constant and may be interpreted as the probable 
error of a mean of unit weight. Further, as also shown above, Zj, 
Za,- • may be viewed as the means of /bVpx^^ - 

individual measurements, all of the same precision. With this rmder- 
standing, Eqs. 1 and 24 may be used to obtain the desired mean and 
its probable error. They 3 deld 


z = 


SwZ 

'Zw 


<4) 




and 


PT 


VX 


Vs 


tW 


^2 


VT 


\fe— 2 

' PX 


[27] 


[28] 


It is seen that px is smaller than the probable error of any of the inter- 
mediate means. 

In illustration, where (10.0 =b 0.2) gm, (10.2 dz 0.5) gm, and (9.9 zh 
0.4) gm are the intermediate means-, we have, corresponding to an 
arbitrary selection of 4 gm^ for the following results: 


z 






PS 

2 

^ „_2 



PT 

PS 

10.0 gm 


0.2 gm 

100 

1000.0 gm 

10.2 


0.5 

16 

163.2' 

9.9 


0.4 

25 

247:5 




141 

1410.7 gm 


Z 

^ 1410.7 gm^ 10 00 

gm 


PS 

2 gm 
~ Vl41 

= 0.17 gm 



7. The Precision Index of a Precision Index. In reporting a precision 
index, a question of concern is that of the extent to which it should be 
expressed. Should the number of significant digits be one, two, three, 
or more, or should it vary with the case at hand? A common-sense 
answer will usually suffice, and without doubt the number of digits de- 
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pends on the case at hand. Obviously when n is large, more confidence 
may be given to derived values for p and cr than when n is small, but 
this rule is only roughly comparative. It would be highly gratifying, 
however, to have a rule based on theoretical considerations if possible 
which is universally applicable. 

One rule ^ states that the standard deviation of a- itself is given ap- 
proximately by 


(Ta = 


cr 

V2(n - 1 ) 


[29] 


For example, if = 9, ll'\/2(n — 1) = 34 and therefore one need' re- 
cord not more than two figures in a and, at that, the second figure is 
barely significant. With n = 9 and the first digit 8 or 9, not more than 
one digit is needed. Similarly for probable errors, the rule states that 
the probable error of p is approximately given by 


3V2(n - 1 ) 


[30] 


More than two significant digits are rarely neede d for the p roper expres- 
sion of a probable error, ^ere n = 100, 2/zV 2(n - 1) approximates 
1/14. Depending, in this instance, on whether the first digit of p is 
greater than or less than 2, w’e may well limit the expression of p to 
only two or to only three digits with the last rounded to 0 or to 5; e.g., 
p = 0.42 OT p = 0.115. 

8. Internal versus External Consistency. It has been mentioned, but 
should be emphasized here, that when we consider the mean to be the 
most probable value obtainable from a set of measurements, we make 
the principal assumptions (1) that the measurements are normally dis- 
tributed, and (2) that they deviate from the true value because of acci- 
dental errors only. The first assumption is generally fulfilled to a mod- 
erate degree and in any case can be tested. The second, however, is 
. often invalid; a constant error in theory, apparatus, procedure, etc., 
may cause the mean to deviate from the true value by many tunes its 
probable error. It is impossible to detect such a constant error from 
the frequency distribution of a single set of measurements, or of a set 
of means of measurements taken under essentially identical conditions. 

For the cases thus far discussed, we can proceed only as we have and 
consider all errors accidental. When, however, we wish to combine or 
compare the results of several workers, using different methods, appa- 
ratus, etc., we frequently find evidence for the occurrence of constant 

^Rossini and Deming, /. Wash, Acad. Sci.t 29, 416 (1939). 
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errors. Such discrepancies, for example, are shown in Bleakney^s ^ 
tabulation, presented in part in Table III, of the ionization potentials 
of molecular hydrogen as determined by various observers. 

Table III 

A Set op Inconsistent Mean Values por the H2 Ionization Potential 
AS Measured by Various Observers 

(16.5 ± 0.5) volts (15.4 ± 0.1) volts 

(17.1 rh 0.2) (15.6 dz 0.1) 

(15.6 ±0.1) (15.37 ±0.03) 


These values differ from each other much more than their probable 
errors indicate that they should. Constant errors must have entered 
into some or possibly all of the determinations. It would be incorrect 
to combine these means into a grand mean and compute its probable 
error by Eqs. 27 and 28. We are thus faced with two problems: (1) 
How may inconsistent means be combined best into a grand mean and 
its probable error determined ? (2) When is a set of means to be con- 
sidered inconsistent rather than consistent? 

9. Testing Intermediate Means for Consistency. Several tests for 
consistency of means have been proposed, some more arbitrary than 
others. Thus, for thermochemical measurements, Rossini and Doming ^ 
propose that two means be considered inconsistent when they differ by 
more than twice the sum of their standard deviations. A second test 
for inconsistency compares the difference between two means, X 2 — Xi, 
with the standard deviation, <r, of that difference; and if the probability 
of occurrence of a difference as great as X 2 “• Xi on the basis of the 
computed o- is found to be less than 0.01, the means are declared incon- 
sistent. The procedure follows. It can be shown (Chap. IX) that the 
standard deviation of the difference of two means of normally distributed 
sets of measurements is related to the standard deviations of the means 
by the equation 

"■(Xj-Xi) = - [31] 


With the cr(X 2 ~ri) determined, the corresponding hx is then obtained 
using the relation 


X2 — Xi ^ X2 — Xi 

+ o-x/) 


[32] 


Next in Table II, Appendix 2, one seeks the probability of occurrence 
of an Jte as great as that just computed or greater. The decision follows. 


^ Bleakney, W., Phys. Rev., 40, 497 (1932). 
® Rossini and Deming, op. cit., p. 416. 
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If the computed hx turns out to be greater than 1.83, the means are 
to be declared inconsistent on this basis. 

A third criterion of inconsistency, proposed by Birge/ consists in 
assigning the arbitrary weights k^/p^f, etc., to the set of n 

means and calculating the grand mean by Eq. 27. Then, on the basis 
of internal consistency, the probable error of a mean of unit weight is 

Pinternal ^ k 

and on the basis of external consistency, applying Eq. 19, it is 

^external 0.67 [34] ‘ 


Hence, if the set of means is consistent, the ratio 

= 0.67 

^internal 


[35] 


should equal unity except for statistical fluctuations. Birge assumes 
that the ratio Pextemai/Pintemai IS normally distributed about the mean 
value, 1, with the modulus of precision -y/n* The probability of occur- 
rence of an observed deviation from unity may then be found by calcu- 
lating the corresponding value of hx 

fee = (2^^ - i) [36] 

VPinternal / 

and using Table II, Appendix 2. If this probability is less than 0.01, 
i.e., hx > 1.83, the means are considered inconsistent. 

Because of the assumptions made in deriving Eqs. 32 and 36, the 
probability values obtained do not have the exact significance that has 
been given them. Nevertheless the tests are useful for detecting in- 
consistencies in values obtained by different observers. 

10. Combining Inconsistent Means. When a set of means is not con- 
sistent, we may assume, for lack of anything better, that the constant 
errors which enter to cause the means to deviate from the true value 
are distributed normally. We then have as alternate methods for find- 
ing X : (1) averaging the intermediate means without regard to weights 
or probable errors; (2) assigning arbitrary weights to the intermediate 
means, perhaps on the basis of experiencejwith the customary accuracy 
of the observers involved, and finding X by applying Eq. 1; or (3) 

' 1 Birge, R. T., Phys. Eeo., 40, 213-224 (1932). 

^ See footnote on page 167. 
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assigning weights proportional to^the inverse squares of the reported 
probable errors and calculating X. by Eq. 27. This is equivalent to 
assuming that a worker who obtains a great number of values, or very 
consistent ones, is more likely to eliminate constant errors than a worker 
whose values are fewer or less consistent. Generally method (2) or (3) 
is preferable to (1). 

Regardless of which of the three methods above is used for calculating 
T, Eq. 28 should not be used for finding pf , since, because of constant 
errors, X is not as accurate as this result would indicate. Instead, we 
should consider the intermediate means to be elemental observations, 
weighted in accord "with the method used in obtaining X, and calculate 
Vx by applying Eq. 24. Calculating the grand mean and probable 
error for the values of Table III by Eqs. 27 and 24 yields (15.44 ± 0.07) 
volts. This indicates the accuracy with which we know the H 2 ioniza- 
tion potential better than the value obtained by using Eqs. 27 and 28, 
namely (15.437 =h 0.027) volts. 

11. Why Inconsistent Means? Several reasons for inconsistent means 
i^iay be mentioned. In what follows we shall ignore errors that are 
purely computational. 

(a) Errors of Construction of Instruments. These errors are numerous. 
Consider the spectrometer. The angle scale may be irregular, it may be 
mounted eccentrically with respect to the main vertical axis, it may be 
mounted with its normal at an angle with the main vertical axis. The 
collimator and the telescope may not point perpendicular to or toward 
the main axis. Other constructional faults are more or less obvious. 

(5) Errors of Experimental Procedure. Readings may not be taken in 
a truly chance order. Particularly, if p-values are determined for a 
sequence of a:-values increasing or decreasing consistently in magnitude, 
possibilities for a gradual instrumental or other drift may not be ob- 
served though observable. A one-sided scale illumination may be used. 
Where cross-hair settings are made, this may be a source of considerable 
error. Readings may be taken under conditions where an observer 
making settings is cognizant of the general trend of the readings taken. 
Under such conditions succeeding settings will not be independent. It 
is rather difficult for one making settings to follow a setting that he 
believes low, for instance, in consequence of readings reported, with a 
setting that is not biased in the opposite direction, A maker\s scale 
may be assumed correct. Temperature variations may be ignored. 
Faulty instrumental construction may be ignored. Where small elec- 
trical emf^s and small variations are important, constructional materials 
and designs become vital. Other procedure errors are more or less 
obvious. 
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(c) Errors of Statistical Treatment One may attempt to determine a 
precision index for a case where the least count is of the same order of 
.magnitude as the precision index to be determined. One may easily 
obtain an exalted view of one^s own precision under these circumstances. 
One may assume an erroneous distribution of variations of observed 
values from the mean. Generally the apparent inconsistencies between 
means will be lessened rather than increased on this score. One may fail 
to assign weights properly to the various readings forming a group. 
A single reading whose weight is given as zero by the application of 
Chauvenet’s criterion may, if included, yield a mean to which but 
little weight may be given. One may ignore or treat incorrectly the 
contributions of certain factors in determining a precision index for 
a mean. See Chapter IX, which concerns the propagation of precision 
indexes. 

(d) Errors of Theory. Difficulties arise here particularly when some 
one or more constants enter in the production of widely differing phe- 
nomena. The case is well illustrated in Chapter X in the discussion of 
the present dilemma with regard to the constants of atomic physics. 
Errors of theory are not always easy to correct. 

(e) Errors of Unsuspected Sources. These are the errors that remain 
after all other imagined probable sources of error are given considera- 
tion. With discovery, an error belonging to this group is transferred 
at once to one of the above groups. 

12 . Sununaxy, When combining readings certain of which are be- 
lieved more reliable than others, the resultant mean is believed improved 
if relative weights are assigned to the individual readings. Specifically, 
if Pi and p2 f^e probable errors of two observations, Xi and X2, 
the relative weights are given by 


W2 


[ 10 ] 


and the mean of the series of observations is found to be 

XwX 


J = 


Sw 


[ 1 ] 


The probable error of the mean of n observations is given by 

Px 


PX 


y/ n. 


[ 22 ] 
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if all the observations are equally precise, or by 




\/2iy 


0.67 Y 


vSiW 


[24] 1 


where :r = X — X, if the observations are ungual in weight. 

Generally it is more convenient to calculate X and o-x by the equations 


and 


X = X^ + A = X' 


^w(X - XQ 


= 


^w{X - X'f— 

nIiW 


[25] 

[26] 


where X' is a convenient, assumed, approximate mean and A = X — X', 
than it is to use the defining equations. 

The probable error of a calculated probable error is approximately 


3V2(» - 1) 


[30] 


A group of means with known probable errors may be combined into 
a grand mean, X, and its probable error computed by the equations 



and 


VI == 




1 


[28] 


where fc is an arbitrary constant, if the intermediate means are consistent 
with each other. If they are inconsistent, X may be obtained by aver- 
aging without regard to probable errors or, preferably, by weighting 
arbitrarily or inversely as the squares of the probable errors and using 
Eq. 1 or Eq. 27. The probable error of the grand mean of a set of 
inconsistent means should be obtained by applying Eq. 24. 

To test two independently obtained means for consistency, we may 
calculate ho by Eq. 32 or Eq. 36. .. If, roughly, Jix > 1.83, the means 
may be considered inconsistent. 


^ See footnote on page 167. 
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PROBLEMS 


1 , Given the intermediate means: 


10.01 d: 0.25 gm 

9.98 ±0.04 gm 

10.00 ±0.12 

9.97 ±0.06 

9.99 ±0.05 

9.96 ±0.15 


Find tlie best grand mean and its probable error. 

2; Show that if 400 measurements of equal precision are divided into five groups, 
of say 40, 60, 80, 100, and 120 readmgs, selected at random, to yield intermediate 
means with varying probable errors, and these are then combined to yield a grand 
mean for the whole group with a probable error determined by the method outlined, 
the results will be the same as those obtained by treating the 400 measurements as a 
single group. 

3. Beattie,^ summarizing the values obtained for the ice point on the Kelvin 
scale, gives the following for the measurements reported in 1937 and before. On 
the basis of these data, what is the expected value of the ice point? First treat all 
as belonging to a single group and then second as belonging to two separate groups. 


Gas Used 

Method 

No. of Points 

T 

He 


21 

273.176* K 

He 


10 

.157 

Hs 


19 

.139 

Hz 

ap 

8 

.131 

Nz 

OLf) 

27 

.138 

Nz 

Ctp 

15 

.143 

Ne 

<Xv 

4 

.212 

Ne 

ap 

4 

.129 


Are the means for the two groups consistent? Why does not the grand mean for 
the two groups check with the group mean? 

4. In Bearden^s paper Determination of ejm from the Refraction of X-Rays 
in a Diamond Prism'’ (F%s. Eev., 54, 698 (1938)), there is given, in Table I, a set of 
experimental values for 5, i.e., 1 - ju, where ii is the index of refraction. In Fig. 4 of 
that paper there are given the weighted mean values of e/m as obtained by various 
workers, together with their probable errors. Find (1) the mean of the 5’s given in 
Table I, together with its precision indexes, and (2) the weighted mean value of e/m, 
taking into account all values plotted in Fig. 4 of the paper, together with its prob- 
able error. 

1 Beattie, James A., in Temperature — Its Measwrem&ni and Conird in Science and Indusiryt p. 83, 
New York, Remhold Publishing Corporation, 1941. 



204 INDEXES OF UNEQUALLY WEIGHTED MEASUREMENTS 

5. Dunnington ^ has given the foUo'?\ing summary of eluM measurements for the 
electron- Compute the weighted mean and its probable error. 


Experimenter 


Date 


Method 


10 


10-3 


V 


emu 


emu 


Bound Electron or Spectroscopic Group 


Houston 

1927 

Fine structure H^ — He^ 

1.7607 

10 

Kinsler and Houston 

1934 

Zeeman effect 

1.7571 

7 

Shane and Spedding 

1935 

Fine structure H^ — H^ 

1.7582 

4 

Williams 

1938 


1.7580 

4 

Houston 

1938 


1.7593 

5 


Free Electron Group 



Perry and Chaffee 

1930 

Linear acceleration 

1.7610 

10 

Kirchner 

1932 

Cl 

1.7590 

9 

Dunnington 

1937 

Magnetic deflection 

1.7597 

4 

Shaw 

1938 

Crossed fields 

1.7581 

13 

Bearden 

1938 

X-ray refraction 

1.7600 

3 


1 Dunningtoa, F. G., R&a, Modem Phya., 11, 65 (1939). 



CHAPTER IX 


THE PROPAGATION OF PRECISION INDEXES 


1. lutroductioii. In Chapter VI it was shown that the arithmetic 
mean of a series of measurements is the “best” value of the quantity 
measured, and in Chapters VII and VIII methods of obtaining the 
precision indexes of such measurements and means were described. In 
a great number of cases, however, the quantity sought cannot be meas- 
ured directly but must be calculated from the means of two or more 
other directly measured quantities. Thus, we have 

(a) a length which is obtained by subtracting one position reading 
from another; 

(b) the specific heat, c, of the material of- a body which cools by radi- 
ation only, in vacuo, in accord with the equation 


dQ/dt 

mdT/dt 


[ 1 ] 


where m, dQ/dt, and dT/dt are, in order, the mass of the body, its rate 
of loss of energy by radiation, and its rate of cooling; 

(c) the computed first radiation constant, a (often called the Stefan- 
Boltzmann constant), as obtained from the equation 




[ 2 ] 


where h, h, and c are, in order, the Boltzmann atomic constant, the 
Planck constant, and the velocity of light in free space; and 

(d) the index of refraction, n, of the glass of a prism for a particular 
wavelength of light, obtained with the aid of a spectrometer, using the 
equation 

. A+D 
sm — r — 


sin — 
2 


where A and D are the angle of the prism and the minimum deviation 
produced by the prism for the particular wavelength of light used. 
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It is, of course, just as desirable to know the reliability of such in- 
directly measured quantities as of the directly measured ones previously 
discussed. 

Evidently the precision indexes of a calculated quantity depend on 
the indexes of the measured quantities of -which it is a function. Their 
calculation, given the means and the precision indexes of the measured 
quantities, is based on the following theory of the propagation of pre- 
cision indexes. 

In this chapter we shall consider how to determine the precision 
indexes of an indirectly measured quantity, U, in terms of the directly 
measured quantities X and Y and their indexes, first for special cases 
such as those involving sums, products, etc., and finally for the general 
ease where U is any function of X and F. The application of the 
principle of the propagation of precision indexes to the problem of de- 
signing experiments is also discussed. 

2. Cases Involving a Sum or Difference. Let 

U^X+Y [4] 

where X and F are the means of two separate sets of readings, with 
probable errors pj and py. We assume that each of the two sets in- 
volved the same number of readings, say 20 or 50, with precisions such 
as to give the resultant values of px and py. Whether or not the actual 
sets of observations involved equal numbers of readings is immaterial. 
All that is necessary is to be assured that the assumed sets are equiva- 
lent to the actual sets. 

With the pairing done at random, let the assumed individual X and Y 
readings be paired off to give (Xi, Fi), (X 2 , F 2 ), etc. We may then wjrite, 
where t^i, xi^ yi, etc., are deviations from the means 

== 17 + == Xi + Fi = X + + F + 

II 2 == f7 + '^2 ~ X 2 “h F 2 = X “h “h F + 

In view of Eq. 4, these may be rewritten as 


[7, X, and F 
2/1 

2 / 2 , etc. 


[5] 


+ 2/1 

U 2 = X 2 + P 2 > etc. 


\u 


By definition 
However, 

+ 2Sa;2/ + 

* See footnote on page 167. 


[ 6 ] 

[7]- 

[ 8 ] 
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of which for the normal case we set 

22x2/ = 0 [9] 

because any particular product xy is as likeij^ to be positive as negative 
and the summation on that account will tend toward zero. It follow^s 
that 

(TU = + cry^ [10] 

vv = vp?n^ [11] 

and similarly for the other precision indexes. 

The probable error of a sum is less than the sum of the probable 
errors of the components. Rather, it is the square root of the sum of 
the squared probable errors of the components. 

It is evident that where O' = X — F, the equation corresponding to 
Eq. 8 will be 

'Zv? - 2x2 - 22x2/ + [8a] 

and that the final expressions for aij and 'pxj will be identical with Eqs. 
10 and 11. 

3. Cases Involving a Product or a Quotient. Let 

TJ ^XY [ 12 ] 

Then, with the same assumptions as were made in the preceding sec- 

tion, we obtain 

= XiFi, etc. [13] 

TJ ui = (X + xi)(Y + 2/i) = XY + + ViX + Xi 2 /i, etc. [14] 


and, since the product Xi2/i is of the second order in comparison with 
the other terms 


and 

As before, 
so that 

and finally 


ui = xiY -\- ViT., etc. 

[15] 

Sw® = + 2X7Sxy + 

[16] 

o 

II 

[17] 

(TU — i" “ 2 + 2 

nr nr 

[18] 

^YW + TW 


•x'T 

TP 

[19] 
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and 


J72 - J2 + p2 


[ 20 ] 


Following a procedure very similar to the above, it is not difficult to 
show that for the case of a quotient, where 

= I [12a] 

the expressions obtained for au and pv are exactly those of Eqs. 19 and 
20. The proof of this fact is the subject of one of the problems at the 
end of the chapter. 

4. Cases Involving Multiplying Constants and Constant Powers. 
Let 

U = AX^ [21] 


On the basis of the assumptions made in the previous two sections, we 
obtain in order 



Ui = AXi^, etc. 

[22] 


U + Ui = A{X + etc. 

[23] 


ui = AaxiX'^'^^, etc. 

[24] 

and 

Su® = A^a^X^'=‘-^Xx^ = 

X^ 

[26] 

whence 

cru <Tx 

[26] 


U^'^X 

and 

11 

[27] 


Note that the a in Eqs. 26 and 27 is the square root of and hence 
may always be taken as positive, regardless of the sign of a in Eq. 21. 

6. The General Case. Let 


?7=/(X, F) [28] 

Applying Taylor^s expansion and making the assumptions of the pre- 
vious sections, we obtain, evaluating the partial derivatives at U = U 
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'0+^1= f(X + xi, F + yi) 


/dU\ , /dU\ 


/W' 

dx) VaF, 


1xy + 


hxy = 0 
so that 




0-X + 


Pu = 


/V 2 ^ {dUY 

i) + Isyj 


Obviously, Eqs. 32 and 33 apply to the special cases discussed above. 

6. Solutions of Illustrative Problems, (a) With what precision may 
the sine of an angle in the neighborhood of 75^ be determined when the 
probable error of the angle measurement is 0.02°? 

Solution: 

[7 = sin X [34] 


1||£ - 0.26 -0.00009:36]' 


yu = (cos 75°) X 0.02° X 


(6) What is the computed first radiation constant and its probable 
error, using the relation 

2 ^'*' 121 

"’liw ™ 


and the following values for k, h, and cf 

k = 1.3803 X 10“^® (1 ± 0.00023) erg/(molecule K°) 
h = 6.6283 X lO"'^’’ (1 db 0.00013) erg sec 
c = 2.99776 X 10^° (1 ± 0.000013) cm/see 

^ That the radian is a natural unit for the sine of an angle and for its probable 
error as well as for the angle itself is generally ignored. That it may be so considered 
seems supported by the well-known expansion 

sin 6 = 6 — 6^/31 + 6^/Bl — • • • 
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Solution: 

Appljdng Eq. 33, one obtains 



= 16(0.00023)2 + 9(0.00013)2 + 4(0.000013)2 [38] 

p, = O.OOlOcr ' [39] 

and the constant, after its value has been separately determined, may 
be reported as 

O' = 5.660 X 10“"^ (1 ± 0.0010) erg/ (cm2 

7. Cases Where the Precision Indexes of the Component Quantities 
Are Not Independent Any propagation equation will yield incorrect 
results unless the directly observed precision indexes are truly inde- 
pendent, Special care should be taken when using one of the special- 
case equations. Thus, if _ 

V = 2X [41] 


we may find pu correctly by Eq. 27 on the basis that V = AX°^ with 
A = 2 and a = 1. Then 


Pu = ^PT ^ 2px 


If, however, we use Eq. 11 assuming U = X Y and that- Xj = Fi, 
X 2 = Y 2 j etc., we obtain 

Pu = = \/2px [43] 

which is too small by the factor \/2* This error arises in accepting 
the assumption, made during the derivation of Eq. 11, that the pre- 
cision indexes of X and F are independent and that therefore Xa;?/ is 
negligibly small or zero. However, the assumption of independency is 
not justified here and J^xy cannot be set equal to zero. 

Similarly, to find ptj when U = X^, we use Eq. 27 on the basis 
U = AX“ ]^th A = 1 and a = 2, and not Eq. 20 on the assumption 
that U = XY where X = F. Simple cases such as these can usually 
be handled without diflSculty if the general propagation law, Eq. 32 or 
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Eq. 33, is applied, but they do indicate how difficulties arise when the 
component precision indexes for X, Y, etc., are not independent. 

A somewhat more complex case is illustrated in Eq. 3. If one views 
the quantity n as the simple ratio of two measured quantities and at- 
tempts to apply Eq. 20, he will neglect the fact that the numerator and 
denominator are not independent. The correct procedure for this 
case is the subject of one of the problems at the end of the chapter. 

A still more complex case cited by Birge ^ is that of finding the pre- 
cision index of the Sackur-Tetrode constant, Sq, as defined by 


= i?o In 


h^No^- 


[44] 


of which Rqj kj eo, h, and A^o represent, in order, the ideal gas constant, 
the Boltzmann atomic constant, the base of natural logarithms, the 
Planck constant, and the Avogadro number. Actually, not one of the 
variables on the right-hand side of the equation is independent of the 
others. Thus, 

( 1 ) ™ 

where Vn, An, Tq, and /is, representing respectively the molal volume 
of an ideal gas under standard conditions, the standard atmosphere, 
the ice-point, and the mechanical equivalent of heat, are independently 
measured, 

(2) No = - [46] 

e 


where F, c, and e, representing, in order, the faraday, the ratio of the 
escoulomb to the abcoulomb, and the electronic charge, are independ- 
ently measured, 


(3) 

Rq VnAn^ 

~ Wo ~ ToJisFc 

[47] 

and 

11 

1 


(4) 

[48] 


The last equation is necessarily thus written because not h but A/e can 
be directly measured. 

The calculation of the precision index of So is even more complicated 
than Eq. 44 would lead one to believe. In the process, one normally 
substitutes for Rq, A, h, and No the values given by Eqs. 45 to 48 and 

1 Birge, R. T., Am. Phys. Teacher, 7, 356 (1939). 
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follows up with the standard procedure discussed earlier. The equation 
obtained by the substitution is . . „ 

,Jv^AnY 

i2Ty-eo'-l-z^) 

„ VnAr. . 

^ [49] 


(Fc)M- 


8. Use of the Law of Propagation of Precision Indexes in Planning a 
Precision Experiment. When it is desired to obtain U with a certain 
precision, pUi we may use Eq. 33 to calculate the maximum permissible 
values of and py- Thus, one method of measuring the surface ten- 
sion of water, T, makes use of the equation 


rhdg 

T" 


[50] 


where h is the height of rise of water in a capillary tube of internal radius 
r, d is the density of water, and g is the acceleration of gravity. Assunae 
that a precision of T is desired such that p^/T = 0.001. We then 
wish to find the maximum allowable precision indexes for r, h, d, and g, 
first to see whether or not they are attainable, and second, in order that 
excessive time, money, and labor are not spent in measuring one or more 
of these quantities to a higher precision than is necessary. By Eq. 33 

To obtain a preliminary estimate, we assume that r, h, dy and g may 
be obtained with equal fractional precision. The maximum permissible 
fractional probable error is then given by 


Px 

X 


/l ( Pt\^ 

J I = 0.0005 


[52] 


where X may represent r, h, d, or g. Thus for the approximate consistent 
set of values for r, A, dy and g of 0.3 nom, 5 cm, 1 g/cm^, and 980 cm/sec^, 
the corresponding probable errors should not exceed 0.0001 mm, 0.02 
mm, 0.0005 g/cm^, and 0.5 cm/sec^. Ordinarily it would be extremely 
difficult to obtain r and h with this precision. However, d and g may 
both be easily obtained to precisions greater than those speciflecj. Hence, 
d and g may be assumed to be without error in this calculation of per- 
missible probable errors for the component quantities. Eq. 51 now re- 
duces to 

[53] 


(fT= (7)+ 
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Assuming that r and h may be measured mth equal precision, we now 
have 

- = ^ = 0.0007 [54] 

It follows that the precision for T that is sought requires probable errors 
for r and h which shall be of the order of 0.0002 and 0.035 mm or less. 

It seems highly improbable that such precisions may be obtainable 
for r and h. A conclusion to be dravm is that the method is unsatis- 
factory for obtaining the surface tension of water with the desired pre- 
cision. If we still wish to measure the surface tension with a relative 
probable error of only 0.001, some other method such as the pressure- 
drop method should be considered and analyzed similarly. 

9. Summary. When a quantity, U, cannot be measured directly but 
must be calculated from the mean values of two or more independently 
measured quantities, X and Y say, the precision indexes of U may be 
calculated from those of X and Y with the aid of the law of propagation 
of precision indexes. In general, if 

r=/(X, F) [28] 

the probable error of U, pu, may be obtained by the equation 



and the standard deviation, auj by the equation 




+ 



[33] 


For special cases of Eq. 28, 
given in Table I. 


the corresponding expressions for pu are 
TABLE I 


COERESPONDING SPECIAL FOEMS OP EqS. 28 AXD 32 



It is important to check the independence of the precision indexes of 
the component quantities X and Y , for if they are dependent in part on 
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tlie same measurements, Eqs. 32 and 33 are not valid. The law of propa- 
gation is also valuable in planning precision experiments. If TJ is de- 
sired with a certain 'pv, we may, assuming X and F to be of equal rela- 
tive precisions, calculate, from Eq. 32, maximum allowable values for 
px and pF. Then, knowing the approximate values of px and py, we 
can tell which quantities may be measured roughly, which more care- 
fully than usual, and generally, whether the experiment is a good one 
or a poor one for obtaining V with the desired precision. 


PROBLEMS 

1. A length of approximately 10 cm is measured several times with the aid of a 
calibrated scale. It is concluded that the probable error of the mean of the readings 
taken at one end of the length is 0.03 mm; of those at the other end, 0.05 mm. What 
is the probable error of the mean of the length determinations? 

2. Show that Eqs. 19 and 20 serve as propagation equations for the case where 
U — X/F. Do not use Eqs. 32 and 33. 

3. The probable error of a single reading with a given voltmeter is 0.20 volt ; the 
corresponding quantity for a given ammeter, 0.015 amp. What are the percentage 
probable errors of single determinations of wattages of lamps at their rated wattages, 
obtained from readings on these instalments for the case of (a) a 500~watt, 115-volt 
lamp; Q>) a 60-watt 115-volt lamp; (c) a 60-watt, 32-volt lamp; and (d) a 60-watt, 
8-volt lamp? 

4. Assuming the curves of Fig. 2 of Chapter IV to have geometric slopes of ap- 
proximately one and one-half respectively at points p and q, determine the relative 
precisions with which the physical slopes at these points may be determined. As- 
sume that lines ah and de are approximately equal in length and that the actual 
probable errors for all length measurements are equal. 

6. The relation between resistivity and temperature for polished tungsten follows 
closely the law 



Granted that po> the value at the gold-point, 1336° K is precise, that elsewhere p 
may be so carefully measured that the relative probable error of a single determina- 
tion is 0.005%, and that the exponent of T/Tb has a probable error of 0.005, within 
what probable error can a person locate the temperature of a polished tungsten fila- 
ment by means of a single resistivity measurement in the neighborhood of (a) 1200 ° K, 
(5) 1800° K, and (c) 2500° K? 

6. With what precision may the density of a 10 gm steel bearing-ball of approxi- 
mate density 7.85 gm/cm® be obtained, if the probable error of the determination of 
its average radius is 0.015 mm, and of its mass, 0.05 mg? 

7. The length of a lamp filament of assumed circular cross-section is measured 
with dk rule permitting ^timations of length to 0.1 mm. As an average of 10 measure- 
ments, 273.45 mm with an average deviation from the mean of 0.24 mm is obtained. 
Its diameter, measured in various azimuths at various cross-sections with an instru- 
ment permitting estimations to 0.001 mm similarly yielded, as a consequence of 
50 measur^ents, 0.2550 mm with an average deviation from the mean of 0.0015 mm. 
From a single weighing, its mass is determined as 268.45 mg with an estimated 
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uncertainty of 0.05 mg. Assume the scales for the length and diameter measurements 
exact. If the probable-error method is used in reporting precision, what values may 
reasonably be reported for the length of the wire, its cross-section^ its radiating 
surface, and its density? 

8. In a measurement of the index of refraction of a 60 ° glass prism for the Di line 
(X =: 5895.93 A), the data in the table below were obtained. Assuming the scale 
exact, what is the computed index of refraction? Its probable error? (Note that, 
as shown in Eq. 3, the prism angle appears in both the numerator and the denomi- 
nator.) 

Measueement of Prism Angle 


No. of 
Readings 

Side of Prism 
to Which Telescope 
is Normal 

Mean Scale 
Reading 

Probable Error 
of Individual 
Reading 

10 

Incident 

80° 45' 30" 

20" 

10 

Emergent 

200° 23' 45" 

25" 


Measurement of Deviation Angle at Minimum Deviation 


No. of 

Telescope Position 

Mean Scale 

Probable Error 
of Individual 
Reading 

Readings 

Measured 

Reading 

10 

For undeviated ray 

60° 15' 30" 

20" 

30 

For deviated ray 

6° 45' 20" 

40" 


9. For the degree of dissociation, x, of HI at 629° K, Bodenstein ^ obtained 
0.1914, 0.1953, 0.1968, 0.1956, 0.1937, 0.1938, 0.1949, 0.1948, 0.1954, and 0.1947. 
The relation between x and the equilibrium constant iT, for such a reaction as 


H2 4-l2^2HI 



Determine the equilibrium constant for the dissociation of HI at 629 H and its 
probable error. 

10. Compare the relative precisions of graphically determined geometric and phys- 
ical slopes of curves for the cases where the tangents to the curves form angles 
approximately 0°, 45° and 90° with the a;-axis. 

^ Bodenstein, Max, Z , physik * ChsTfu , 22, 1 (1897). 
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THE ADJUSTMENT OF CONDITIONED MEASUREMENTS 

1. Introductioii. Independent measurements are often made on quan- 
tities that are known or assumed to be related according to one or more 
specific laws. Such measurements are said to be conditioned. Their 
means are not necessarily the most probable values of the quantities 
measured. They must be adjusted to conform to the law or laws relat- 
ing the quantities. Thus, for the three angles of a triangle we may 
obtain as mean values, 30° 2', 60° 2', and 90° 1'. We could not certify 
such values, however, since the sum of the three angles must equal 180° 
exactly. In general, if k quantities are related by n equations, adjust- 
ments are necessary when more than k — n quantities are independently 
measured. 

In this chapter we consider the problem of adjustment first for a 
simple case, and then for the general case, in which the relation between 
the variables is linear. Later we Consider cases involving products, 
powers, and more complicated relations. The treatment of adjustments 
here given assumes that the measurements obey the, normal distribu- 
tion law. It further assumes that the most probable values for the k 
unknown adjusted means are those which yield a maximum probability 
of occurrence for the weighted measured means. In accord with the 
principle of least squares (Chap. VI, p. 163), this condition is equivalent 
to applying the condition of a minimum to the weighted sum of the 
squares of the deviations of the measured means from their adjusted 
values. 

2. Equally Weighted Observations of Linearly Related Quantities. 

Consider first the quadrilateral survey problem of determining the most 
probable values for the elevations of three points R, (7, and D above 
a base A, Using the same letters B, C, and D to represent the eleva- 
tions also, let us assume the following independent observations, all of 
equal weight: 



Measurement 

Quantity 

(feet) 

B 

10.0 

C 

18.0 

D 

4.0 

C-B 

9.0 

C-D 

12.0 

B-D 

5.0 


216 
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Taking account of the uncertainties of measurements, we may express 
these observations in equation form by 


B 

- 10.0 ft = Ai 

[1] 

■ C 

- 18.0 ft = A 2 

[2] 


ta 

1 

b 

II 

[3] 

B + C 

I 

CD 

b 

II 

t 

[4] 

C 

- D - 12.0 ft = As 

1 1 

B 

- D - 5.0 ft = As 

[6] 


of which the A^s represent the unknown adjustments that are necessary. 
These six observation equations, involving only three unknowns, show 
clearly the need of adjustment. From them, follo\\ing the least-squares 
principle and making the sum of the squares of the A's a minimum, we 
shall form three so-called normal equations involving only B, C, and D 
as unknowns. Their solution will yield the most probable values for 
the elevations sought. 

Before proceeding farther wdth the special problem, consider the gen- 
eral solution. Let there be n linear observation equations, of equal 
weight, involving k (where k < n) independently measurable quanti- 
ties, Qi, Q 2 , • * 'Qk- Thus, in the adjusted form, they are 

(^iQi 4- & 1 Q 2 + V* ‘kiQk — Xi = Ai 

<^2Qi “b ^2Q2 H — 'k2Qk X 2 = A 2 [7] 


(^nQl "b ^nQ2 H *knQk ~ -^n — 

Here Xi represents the observed value of (aiQi + hiQ 2 d — 'kiQk)j 
etc., and the A’s represent the small unknown adjustments necessary 
for consistency. Comparing Eqs. 7 one by one with Eqs. 1 to 6, w^e 
see that Qi, Q 2 , Qs represent the quantities (7, D; that the coeflhcients 
ai, 5i, Cl take the values 1, 0 , 0 ; that 02 , ^ 2 , C 2 take the values 0 , 1 , 0, etc. 

It is necessary that all the A’s of Eq. 7 be of the same physical nature, 
since their squares are to be added. 

Maximum probability of occurrence of the observed set of X's re- 
quires, as stated, that 2)A^ shall be an absolute minimum. Since the 
Q's are the independent variables, it further follow^s that 

^ ^ a(SA^) 

dQi dQ2 ^Qh 


[ 8 ] 
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Considering now only 

a(SA") 

BQi 

rewrite the observation equations as 

(^iQi "b = -^1 
<^2Qi + ^2 = ^2 


[ 9 ] 


[ 10 ] 


(^nO/l H” -^n 

where Ai replaces (&1Q2 +* * 'kiQh — ^1) etc. It follows that, as an 
abbreviation, 

(Qj^Sa^ + 2Qi^aA + SA®) 

dQi dQi 

= 2[(2:a2)Q., + ZaA] = 0 [11] 

The summations here as well as those in the following equations are strictly 
of the type So,ai and Sa,\ 4 j-. By an exactly similar procedme,we obtain 

(S62)Q2 + S6B = 0 

(Sc 2 )Q 3 + ScC = 0 

[ 12 ] 


( 2 k^)Qk + 'SkK = 0 

These equations are the normal equations for the unknown adjusted 
Q-yalues and are exactly equal to them in number. Replacing the 
abbreviations A, hy their equals leads to the following forms, 

more suitable for computational purposes; 

(Sa2)Qi + (Sa&)Q2 + (^ac)Qs + • ■ • (SoA:)^* - SaX = 0 

(Sa6)Qi + (Eb^)Q2 + C^bcjQs +---X^bk)Qk - S6Z = 0 

(2ac)ai + (26 c)Q2 + (Sc2)(93 + ■ • ; (^ck)Qk - 2cZ = 0 


C2ak)Qi + (26A:)Q3 + C2ck)Qs + • ■ ■ (M^)Qk - S*Z = 0 

The values for Qi, Q2, Qk obtained by solving Eqs. 13 simultaneously 
will be the most probable values for those quantities. Inspection shows 
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that Eqs. 13 may be obtained from Eqs. 7 rather simply. To obtain 
the first normal equation, one merely multiplies each of Eqs. 7 by the 
cocflScient of its Qi and takes the sum. Similar procedures yield the other 
normal equations. Note that the summations involving the A^s, in view 
of Eqs. 10 and 11, equate to zero. For the worker who has occasion to 
solve numerous sets of normal equations, the mastery of some syste- 
matic method of solution, such as that of Gauss or of Doolittle, is recom- 
mended. For others, the method of determinants, given in Appendix 1, 
should prove most convenient. 

Returning to the problem of the quadrilateral survey, we find, as a 
result of the specified treatment, that our special-case normal equations 
become 

35- C- D- -6.0 ft -0 

-5 + 3C- Z) -39.0 ft = 0 [14] 

-5 - C + ZD + 13.0 ft = 0 

Note, in this connection, that the Xi of Eq. 1 is +10 ft, not —10 ft. 
There result, for 5, C, and D in order, 934 ft, 17M ft, and 4M ft; and 
for the A's, likewise in order, —34 ft, ~34 ft, M ft, —M ft, 1 ft, and 
— 34 ft- He who doubts that the above set of A's possesses the least 
value for S A^ is invited to test it against any other set, however obtained. 

Consider as a second case that of the angles of a plane triangle. Let 
the angles be a, and y, and their measured values. A, B, and (7, all 
equally precise. What are their most probable values? There are but 
two independently valued angles; the third angle, y say, is to be con- 
sidered as 180^ — a — jS. Our observation equations are, accordingly 

a — A = Ai 

- 5 = A2 [15] 

-O' - + (180° - C) = Aa 

The normal equations become 

2a + iS + (0 — A — 180°) == 0 
oi + 2/3 + (C — ‘ B — 180°) = 0 

whence 

180° - C - A + 25 
^ “ 3 

180° - C - 5 + 2A 


[16] 

[17] 


3 
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3. Unequally Weighted Observations of Linearly Related Quantities. 
Referring to the previously considered problem of determining the most 
probable elevations at the corners of a quadiilateral, let probable errors 
be given for the measured quantities. With B, C, and D represen ting ^ 
as before, elevations above A, assume as the available data 



Measurement 

Probable Error 


Quantity 

(feet) 

(feet) 

Weight 

B 

10.0 

0.2 

25.0 

C 

18.0 

0.5 

4.0 

D 

4.0 

0.6 

2.8 

C-B 

9.0 

0.4 

6.2 

C-D 

12.0 

0.8 

1.6 

B-D 

5.0 

1.0 

1.0 


As shown elsewhere, weights are chosen proportional to the inverse 
squares of the probable errors. The procedure is the same as before, 
except that now w'e consider in effect the first observation equation 
repeated 25.0 times, the second, 4.0 times, etc. The normal equations 
for the general case with linear relationships become 

(W)Qi + (2wa6)Q2 + (BwaX) = 0 

(2wab)Qi + (Swb^)Q 2 + (BwhX) = 0 

[18] 


(2wa/c)Qi + (Swbk)Q 2 H (EwkX) = 0 

In computing the coefficients Swob, etc., of Eqs. 18, a tabulation 
such as that employed in Table I will be found very helpful in the elimi- 
nation of computational errors. 

For our special case of elevations at the corners of the quadrilateral, 
the normal equations involving weights become 

32.25 - 6.2(7 - 1.05 - 199.2 ft = 0 

-6.25 -b 11.8(7 - 1.65 - 147.0 ft = 0 [19] 

-1.05 - 1.6(7 + 5.45 + 13.0 ft = 0 

Solution of Eqs. 19 yields 9.86 ft, 18.30 ft, and 4.84 ft for 5, (7, and 5. 

These values differ appreciably from those obtained on the basis of equal 
weights. 
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TABLE I 


Illtjsteating a Convenient Checking Akrangement for Use in Finding the 
Coefficients of the Normal Equations (Three in Number as Illustrated) 
FOE Weighted Conditioned Measurements 


wa 

waa 

wah 

wac 

waX 

Sums 

25.0 

25.0 

0 

0 

250.0 

275.0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

-*6.2 

6.2 

-6.2 

0 

-55.8 

-55.8 

0 

0 

0 

0 

0 

0 

1.0 

1.0 

0 

-1.0 

5.0 

5.0 






224.2 

Totals 

32.2 

-6.2 

-1.0 

199.2 

224.2 

wh 

whh 

whc 

wbX, 

Sums 

0 


0 

0 

0 

0 

4.0 


4.0 

0 

72.0 

76.0 

0 


0 

0 

0 

0 

6.2 


6,2 ' 

0 

55.8 

62.0 

1.6 


1.6 

-1.6 

19.2 

19.2 

0 


0 

0 

0 

0 






157.2 

Totals 


11.8 

-1.6 

147.0 

157.2 

wc 

wcc 

wcX 

Sums 

0 



0 

0 

0 

0 



0 

0 

0 

2.8 



2.8 

11.2 

14.0 

0 



0 

0 

0 

-1.6 



1.6 

-19.2 

-17.6 

“1.0 



1.0 

-5.0 

-4.0 






-7.6 

Totals 



5.4 

-13.0 

-7.6 
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4. Observations of Nonlinearly Related Quantities. In a large per- 
centage of cases, conditioned quantities are related by nonlinear equa- 
tions. Four examples may be cited. ( 1 ) The first concerns C 2 , the sec- 
ond radiation constant; A, Planck’s constant; c, the velocity of light* 
and k, Boltzmann’s atomic constant; which are related by the equation 

he 

= j [ 20 ] 


Although aU four quantities may be independently measured, the values 
of only three may be independently specified for a consistent set of the 
constants. ( 2 ) The second concerns the four independently measurable 
quantities: /i, the porous plug effect; y, the ratio of the two specific 
heats; {dT/dv)^: and (d'p/dT)^, where T, p, and v have their accustomed 
sigmficances ; so related by the equation 


7 -I T- v{dT/dv\ 
Tidp/dT), 


[ 21 ] 


that only three of the quantities may be independently specified. Al- 
though T and v are also independently measurable, they may be ob- 
tained so accurately, relative to the other four constants, that they do 
not enter into any question of adjustments but serve to represent states 
to which adjustments between those four may be ascribed. ( 3 ) The 
third concerns the independently measurable quantities: A, Planck’s 
constant; e, the electronic charge; Rydberg’s constant for the 
atom; c, the velocity of light; and mo, the rest-mass of the electron; 
which are related by ^ 

h^ 

As -vf^ be noted in one of the problems, the adjustments that seem to be 
required in this particular ease are so great as to cause concern regard- 
mg methods of measurement and theoretical relations. ( 4 ) The fourth 
mvolves the specific heat quantities: Cp/ c*; 7 ; and T{dp/dT)^(dv/dT)p, 
a quantity equal to the universal gas constant for the case of an ideal 
gasj which are related by the two equations 



and 


7 == 


Cp 


[24] 
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The method of adjustment for nonlinear cases is well illustrated by a 
treatment of case (1) above. Here we conveniently write as our obser- 
vation equations 

h 




— 1 + A3 

A3 


C2 

Z4 


he 


[25] 


where the X’s and the A^s have the significance given earlier in this 
chapter. Assuming the A’s to be small in comparison with unity, we 
write Eqs. 25 in logarithnoic form, thus: 


In — = In A — In Xi = Ai 
■^1 


In-^-lnc — lnZ2 = A2 

A2 


In — = In * — In Z3 = A3 
InA + lnc — Infc — lnZ4 = A4 


[26] 


It should be noted that the A^s, as well as all the other members of 
Eqs. 26, are numerics.^ That these A^s shall all be of the same physical 
nature is important, since otherwise, the summation SA^ can not be 
applied in an adjustment. 

Consider next the weights assigned to Eqs. 26. Generally, certain 
probable errors will be given for the Z^s; if not, weights are assigned 
arbitrarily. With probable errors given, the corresponding probable 

^ In order that A — In Xi” shaD be a numeric and that both h and Zi shall be 
quantities possessing physical dimensions it is evident that the logarithms of h and 
Zi shall contain, in addition to the logarithms of their respective numerics, Ic^- 
arithms of the units in which the quantities are expressed- These additional terms 
cancel when the difference of the logarithms of the quantities is taken. In all natural 
equations involving logarithms of physical quantities, something like the forgoing 
win always enter to make the checking of units possible. 
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errors for the In X’s follow at once. The principles of propagation of 
precision indexes indicate that 

PXi 

POnXi) — 


[27] 


P(bX4) = 


X. 


The inverses of the squares of these probable errors are the weights 
sought. With weights once assigned to Eqs. 26, we follow the procedure 
leading to Eqs. 19, and obtain 


(wi + W4) Ink + (W4) In c — (W4) In k 

— (wi In Xi + W4 In X4) = 0 

(W4) Ink + (w2 + W4) In c — (W4) In A 

— (w2 In X2 + W4 In X4) = 0 [ 28 ] 

— (W4) Ink — (W4) In c + (ws + W4) In k 

— (w3 In X3 — W4 In X4) = 0 


Using “observed” values for k, c, k, and C 2 ,^ namely 


Quantity Value 

h 6.6283 X 10“^^ (1 ± 0.00013) erg sec 

2.99776 X 10^° (1 d= 0.000013) cm/sec 
k 1.3803 X 10-^« (1 ± 0.00023) erg/K° 

C 2 1.432 (1 ± 0.002) cm K° 


we obtain for the respective weights of their logarithms. 


Wi :W2 :W3 : W4 


f_i_y . f-i-Y- -Y 

\0.00013/ Vo.000013/ \0.00023/ ‘ \0.002/ 


240 : 24000 : 80 : 1 


[29] 


A great variation in the weights is to be noted. Substitution in Eqs. 28 
leads to . 

241 In h 4 “ In c In k (240 In Xi d" In X 4 ) = 0 

In A + 24001 Inc - Infc - (24000 InZg + lnZ 4 ) = 0 [30] 

^ Pli3rsics Staff of the University of Pittsburgh, Outline of Atomic Physics, New 

York, John Waey & Sons, 1937, 2nd Ed., p. 391. 
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• - In A - Inc + 81 In* - (SOlnXs - lnX 4 ) = 0 

from which we obtain 

h = 6.6283 X 10“^^ erg sec 
c = 2.99776 X 10^® cm/sec 

[30a] 

* = 1.3804 X 10'“^® erg/K° 

C 2 = 1.4394 cm K° 


Because of the very low weighting of X 4 , the ' 'observed value^^ for C 2 , 
the values of h, c, and k are not appreciably changed in the adjustment. 
This might have been concluded at the beginning and we might as weU 
have computed C 2 in accord with Eq. 20 and taken that as the adjusted 
value. The value to be thus computed is 1.4396 cm only greater 
by 2 in the fourth decimal place. As will be seen from the discussion 
of the short method of the following section, the actual labor of carry- 
ing out the final computations may be reduced considerably. 

One point of general importance in addition to that of the method of 
adjustment follows from the foregoing discussion. It is that, if one or 
more of the X’s is so highly weighted as to “swamp'" the weights of the 
others, those highly weighted values may well be accepted as fiixed and 
not susceptible of adjustment. 

Sometimes it is not apparent at once how to adjust the given data 
so that the A's directly involved in any adjustment will always be of 
the same nature. Consider the second example cited above. Let- the 
quantities directly measured and for which we have probable errors be 
{dT/dv\, and (dp/dT)^^ The simple procedure here is to intro- 

y — 1 

duce functions of the latter three quantities, H for , J for T — 

y 

v{dT/dv\, and K for T(dp/dT)y, The principles of propagation of 
precision indexes permit the determinations of probable errors for H, 
J, and K. Eq. 21 may now be rewritten as 




K 


[31] 


and, as in Eq. 20, adjustments are now possible for the quantities enter- 
ing Eq. 31. Given the adjusted values for if, J, and K, the procedure 
for finding the adjusted values of 7 , {dT/dv)pf snd {dp/ dT)^ is obvious. 
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Let us also consider the fourth example cited above for which we have 
to adjust four independently measured values connected theoretically 
according to two relations. Here we write as our observation equations 

Cp - Ml = Ai [32] 

c« - M 2 = As [33] 

7 - Ms = - - Ms = A 3 [34] 

t35] 

Evidently A 3 differs in physical nature from the other A’s and some 
change must be made. The simplest thing is to revise Eq. 34, writing 
it as 

Cj, - M 3 C® = A 3 C,, = A's [36] 

of which M^Cv is to be treated as a Q-term of Eqs. 7 and not as an X-term. 
Since both sides of Eq. 34 were multiplied by in obtaining Eq. 36, 
the A '3 compared with the left side of Eq. 36 is as much an infinitesimal 
as is A 3 compared with 7 . Further, since this c^, hke the Cj, of Eqs. 33 
and 35, is an assumed adjusted value, the weight that will be assigned 
to Eq. 36 will be We may now proceed to the adjustment 

of Cp and c® as desired, using Eqs. 32, 33, 35 , and 36. 

6 . Short Method for a Common Type of Adjustment. Where all of 
the quantities to be adjusted or functions of them taken singly can be 
related linearly in a single equation and where each measured value is 
a separately measured value obtained for ope of the quantities to be 
adjusted, a certain simplification of procedure is possible. As such a 
case consider the adjustments for the quantities in the equation 

2x® 

‘’“UW [37] 

of which tr represents the fourth power radiation constant (often re- 
ferred to as the Stefan-Boltzmann constant), k the Boltzmann atomic 
constat, A Planck’s constant, and c the velocity of light. For these 
equations we have the values ^ given in the upper half of Table II. 
If one substitutes the given values for k, h, and c of Eq. 37 , he will 

University of Kttsburgh, Atomic Physics, New York, John 
Wiley & Sons, 1937, 2nd Ed., pp. 389-391. 
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obtain 5.660 X 10“^ erg/ (cm^sec for cr, a value which does not 
check with the stated observed value and shows the need of adjustment. 


TABLE II 

Ceetain' Quantities and Functions and Theie Values foe Use in Illusteating 
A Shoet Method foe a Common Type op Adjustment 


Quantity or 
Function 

Value 

Logarithm of 
Numeric 


2.99776 X 101° ^ 0.000013) cm/seo 

10.47680 

h 

6.6283 X lO'^i (1 ±0.00013) erg/sec 

^.82140 

k 

1.3803 X 10-1° (1 ^ 0.00023) erg/ (molecule K°) 

16.13997 

or 

5.735 X 10-° (1 ± 0.0020) erg/Ccm^ sec K”'*) 

5.75853 

2wV15 

40.803 

1.61069 

A 


20.65709 

Xi 


5.75853 

X 2 


79.46420 

X 3 


63.44012 

D 


“0.00576 


Of the values reported, it is seen that the fractional probable error 
for c is so small compared with that for or that c, because of its “swamp- 
ing effect,” may be treated as exact in the adjustment process. Rear- 
rangement of Eq. 37 yields 

1 2ir^ 

log <r + log + log ^ = log — - log [38] 

which takes account of the stated “swamping” precision of c and may 
be identified term by term with 

Qi + Q 2 H" Qs = 4- [39] 

of which the separate Q’s are to be viewed as the quantities needing 
adjustment. 

A stated condition for the type of adjustment being considered as- 
sumes for the observation equations, Eqs. 7 


Qi — == Ai 

Q2 — ^^2 “ A2 
Qz — “ -^3 


[ 40 ] 
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With eights wij W 2 j these lead in the regular manner to normal 
equations which when solved 3 deld 

Qi = Xi + -i) 

Wi 

Q 2 = X 2 +—D [41] 


Qz = Z) 

Wz 


of which 



and 

^ W1W2WZ 

W1W2 + W2WZ + WzWi 

[42] 


D = A - (Xi + X 2 d- X 3 ) 

[43] 


D represents the discrepancy for which adjustments must be made. 
The fractions B/wi, B/w^, and B/wz must and do add up to unity. 
The manner of obtaining from Qi, Q2, etc., the desired adjusted values 
for the original quantities in any individual case will be obvious. 

In accord with the above, the abbreviated method of adjustment for 
quantities whose fimctional relation is expressible by a linear equation 
consiste of ( 1 ) selecting the necessary functions Qi, Q 2 , etc., for each 
quantity and the form of the linear relation, ( 2 ) determining the weights 
•wi, W 2 , and W 3 to be ascribed to the values Xi, X 2 , etc., determined 
experimentally or otherwise for the linearly related functions or quan- 
tities, (3) determining the discrepancy, D, to be adjusted among the 
linearly related functions, (4) splitting up the discrepancy into compo- 
nent parts which are proportional to the reciprocals of the computed 
weights, (5) applying these component parts to the appropriate Xi, X 2 , 
etc., values, and ( 6 ) computing the adjusted values for the quantities 
whose functions were related linearly. 

Applying the outlined procedure to the adjustment of <r, h, and k, 
need for which was indicated above, we note that step ( 1 ) has already 
been carried through above and that the functions which have been 
selected as Qi, Q2, and Q3 of Eq. 39 are in order log <r, log h^, and 
log (l/k ) and that log (2^yi5c^) has been represented by A. Apply- 
mg step ( 2 ) we obtain for weights Wj, wz, % of Xi, X 2 , X 3 the relation 
111 « 

wi ■ (0.0020) : (3 X 0.00013)2 : (4 X 0 . 00023 )^ 


. 25 1 5 



PROBABLE ERRORS OF ADJUSTED OBSERVATIONS 


229 


Since the last three members of this equation sum up to unity, it follows 
that, in order, they represent the values of B/wi, B/w 2 , and B/wz as 
they appear in Eqs. 41. For step (3) the necessar^^ data are listed in 
the lower half of Table II, and the value to be computed for the dis- 
crepancy D in accord with Eq. 43 is seen to be —0.00576. Following 
step (5), the partition of D into components in proportion to B/wij 
B/w 2 j and B/wz yields in order —0.00464, —0.00019, and —0.00093. 
These applied to Xi, X 2 , and X 3 in accord with Eqs. 41 yield 

Qi = 5.75389 

Q 2 = m46401 [45] 

Qz = 63.43919 

Step ( 6 ) leads to 

cr = 5.674 X 10”^ erg/(cm^sec 

h — 6.6277 X lO""^^ erg sec [46] 

k = 1.3810 X 10“^ erg/ (molecule K°) 


While probable errors for each of these three values may be determined 
by the method that follows, it has not been so done here. Note, how^- 
ever, that the adjustment for <r is about 5J4 times greater than the 
indicated probable error of the observed value and that the adjustment 
for k is twice the probable error. The situation leaves doubt as to 
whether or not the adjustment is advisable. 

6 . Probable Errors of Adjusted Observations. The solution of 
Eqs. 18 leads to the following expression for Qi: 


hwaX 

Ewah 

• * Ewak 

XwbX 

Ewh^ 

• • Ewbk 

XwkX 

Ewbk 

- • Ewk^ 


Ewab 

• * • Ewak 

Ijwab 


• - • Ewbk 

'Ewak 

Xwhh 

• - • Ewl^ 


= aiXi + ^3X2 + 


anXn [ 47 ] 


where ai, <X 2 /* ■ are complicated but easily derivable in terms of the 
coefficients of Xi, Xg, • * 'X„ appearing in the summations Su^aX, HwhX, 



230 THE ADJUSTMENT OF CONDITIONED MEASUREMENTS 
and their minors, etc. It follows that 


PQi = + Ot2^PXi H [48] 

and likewise for the probable errors of the other Q’s. 

For the simple case, already treated, of the elevations of three corners 
of a quadrilateral above the fourth, where the observations are all of 
equal weight, we have 

35- C- D- (Zi -Z 4 + Z 6 ) =0 

~J5 + 3C- D- (Z 2 + X 4 + X 5 ) =0 [49] 

C + 3Z) - (Z 3 - Z 5 - Ze) = 0 

There follow 

B = iXi+ 1X2 + iXs - 1X4 + JXe 

C = iXi + iXa + iXs + iX4 + IXs [50] 

D = iXi + 1 X 2 + 4 X 3 - 1 X 5 - iXe 

where Xi, X 2 , etc., stand for the readings 10.0 ft, 18.0 ft, etc. It follows, 

in accord with the principles of propagation of precision indexes for 
sums, that 


PB = 

Further, since the probable errors of all the Z^s are the same, we also 
have 


4 


Vx‘ 

4 


+ 


Vx, 

16 




16 


+ 


?xl 

16 


Vx‘ 

16 


[51] 


Pb = Pc = Pd 


PXi ^ P^ ^ 

-v/2 V2 


[52] 


Assunoing 0.6 ft as the probable error for each of the six measurements, 
the probable error for the adjusted values for B, C, and D is found to 
be 0.4 ft, a value less than the assumed 0.6 ft. 

7. The Present (1940) Status Relative to the Evaluation of the Con- 
stants of Atomic Physics. The constants particularly under considera- 
tion here are the electronic charge, e, the rest mass of the electron, mo, 
and Planck’s constant, h. Many of the measurements of atomic physics 
involve functions of these three quantities. For example, Rydberg’s 
constant for an infi n ite mass, R„ is defined by 


_ 27r^e^TOo 
ch^eo^ 


[53] 


of which c represents the velocity of light. While Rydberg’s constant 
is among the quantities most precisely determined, the precision for c 
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Summary Showing Experimental Eesults Obtained prom Eleven Different Types op Atomic Measurements Leading to 
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is still higher. Usually both but sometimes only the latter is treated 
as exact when adjustments involving them are undertaken. 

Adjusting observed data in the field of atomic physics to obtain con- 
sistent values has attracted the attention of many physicists. Among 
them we cite Birge/ Bond,^ Dunnington,^ DuMond,^ and Darwin,® since 

TABLE IV “ 

Auxiliary Constants Used by Dxjnnington in His Study op Atomic Constants 


[See Table III] 


Symbol 

Description 

Value Used 

F 

Faraday in international coulombs/gm. equiv. 



wt. 

96494.0 ± 1.5 

c 

Velocity of light in cm/sec 

(2.99776 ± 0.00015) X lOW 

J> 

Conversion factor from N.B.S. int. to abso- 



lute ohms 

1.000485 =1=0.000007 

Q 

Conversion factor from N.B.S. int. to abso- 



lute amperes 

0.999970 ± 0.000020 

flv 

Conversion factor from N.B.S. int. to abso- 



lute amperes 

0.999926 ± 0.000020 

r 

Conversion factor from N.B.S. int. to abso- 



lute volts 

1.0000411 =1= 0.000022 

Rbi 

Rydberg constant for in cm“^ 

109677.76 =1= 0.05 

Ro 

Gas constant in ergs/ (mole K°) 

(8.3136 =fc 0.0010) X 10^ 

kji 

Ratio of mass spectrograph to chemical 



atomic wt. 

1.000275 =h 0.000020 

h 

Ratio of ruled grating to Siegbahn wave- 



lengths (Bearden) 

1.00203 =fc 0.00002 

R<x> 

Rydberg constant for infinite mass in cm”^ 

109737.42 ± 0.06 

N 

Arbitrarily adopted value of Planck’s con- 



stant in erg sec - 

6.6100 X 10-27 


their contributions are basic to the present discussion. References to 
other work will be found in the paper by Dunnington. Altogether 
Dunnington lists results from eleven types of measurements (Table III) 
involving e, h, and mo and functions of them as subject to adjustment, 

1 Birge, R. T., Rev. Modern Phys., 1, 1 (1929); 13, 233 (1941). 

2 Bond, W. N., Phil Mag., 10 (1930); 12 (1931). 

» Dunnington, P. G., Rev. Modern Phys., 11, 65-83 (1939). 

^ DuMond, J. W. M., Phys. Rev., 56, 153 (1939). 

^Darwin, C. G., Proo. Phys. Soc., 52, 202-09 (1940), ^ 
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Darwin includes the determination of as a twelfth. In Table III 
it is shown also just how these measurements involTe the e, hj and mq 
and also certain other experimental constants whose values (Table IV) 
are ordinarily accepted as exact to a higher order of certainty. The 
experimental values with their probable errors as recorded might be 
used, as some have been, to obtain adjusted least-squares values in 
accord with the method described above. Before so doing it seemed 



n 


Fig. 1, A Birge-Bond diagram for testing the consistency of experimental data con- 
cerned with the atomic constants e, h, and wq. The meanings of Cn and n are stated 
in the legend of Table III, where the data for this graph are to be foimd. 

wise to Dunnington, as it had to others before him, to test for consist- 
ency. Assuming the highly precise value for as fixed, it is evidently 
possible to eliminate e or A or from the expression given in the third 
column of the table and to modify the experimental values accordingly. 
If, for instance, the expression obtained by electron diffraction, namely 

- ( —Y = (1.00084 ± 0.00058) X 10'® esu [64] 

e \mo/ 

is so treated and mo, with the aid of Eq. 53, is expressed in terms of e, k, 
and accepted values for R„ and c (Table IV), one obtains 

^ = (0.25558 ± 0.00006) esu [55] 

If further, one substitutes an approximate rounded value, say 
6.6100 X 10~^^ erg sec, for h, he obtains an approximate value, e„, for e. 
Making this substitution, Eq. 55 jdelds 

„ = (4.7964 ± 0.0019) X 10“^° esu 




[ 56 ] 



234 THE ADJUSTMENT OF CONDITIONED MEASUREMENTS 

as shown for the soventh item in the last column of Table III. This 
procedure of first eliminating vfio and then substituting a rounded value 
for A' has been followed by Dunnington. Further, he has presented 
the series of values obtained in a Birge-Bond diagram (Fig. 1), 'in 
which is plotted as a function of n, the power of h corresponding to a 
power of unity for e in the various expressions similar to Eq. 55. 

The half-lengths of the lines of spread associated with any one point 
on the Birge-Bond diagram represents the uncertainties of the com- 
puted SnB. Should the values have been satisfactorily consistent all 
points would have fallen on a -single average horizontal line or so near 
that their lines of spread would have crossed or nearly crossed it. This 
is very far from being the case. There are three groups of values each 
of which separately seems to have external consistency. Whether or 
not the whole group may be said to have external consistency as that 
is defined in Chapter VIII is left for a problem to be found at the end 
of this chapter. To some, adjustments for a case such as this is without 
much meaning. Dunnington and others on this basis have sought for 
possible errors of theory or for faulty experimental procedure. 

With Ai, ^ 2 , ^ 3 , etc., as the experimental values of Table III, Eq. 54 
may be rewritten as 

ln- + iln— = In^T [57] 

e mo 


If, further, approximate rounded values W, e', and m'o are introduced, 
we may rewrite Eq. 57 as 



In Ar [58] 


and, since the A terms will be very small quantities, as 


^ A(Ve) , 1 A(e/mo) , ^ , h' 

Darwin showed that if the A terms were assumed to represent coordi- 


nates and we write 


AQi/e) 

[60] 

_ ^ 

h'/e' 

A(e/OTo) 

[61] 

e'/m'o ^ 

Ae 

[62] 



our Eq. 57 reduces to 


x + ^y Bj db ABr 


[63] 
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of which jBy, representing the right-hand member of Eq. 59, and AB 7 , its 
computed uncertainty, are both small and dimensionless. The other ten 
equations similar to Eq. 63 have similar small values for their 
All are simple and none involves more than two of the unknowns. The 
actual magnitude of the AB^& will depend on accepted values for Pb, 
e.g., 0.95. A certain convenience of treatment follows, due to the pos- 
sibility of thinking of the rc, y, z quantities as space coordinates and of 
the AjS’s as defining slab-shaped regions in this space to which the equa- 
tions predict probable limitations of actual values for rc, y, and z. For 
further details the reader is referred to the original article. After a dis- 
cussion of the discrepancies, Darwin singled out items 1, 10, and 12 of 

Table III as most likely correct and from these three alone concluded 

that the most probable values for the quantities desired are 

e = 4.8025 X 10“"^^ esu [64] 

— = 1.7591 X 10^ emu [65] 

mo 

h = 6.6243 X 10“^^ erg sec [66] 

A satisfactory adjustment of the discrepancies has not been foimd. 

8. Summary. If k quantities are known or assumed to be related by 
n equations, and if more than A — n of the quantities are measured 
independently of one another, the means of the independent sets of 
measurements are no longer the most probable values of the quantities 
measured but must be adjusted to give values consistent with respect 
to the n conditioning equations. The adjustment procedure when the 
quantities are linearly related and the measurements .are of equal weight 
consists of the following steps : 

(1) Write in their adjusted forms n observation equations similar to 
the following two 

“H 5iQ 2 “h * ' 'kiQjc — Xi = Ai 
<^2^1 ”1“ ^^2^2 + • • * k2Qk X 2 = A 2 [7] 

of which the Q^s are the related quantities ; the X's the independently 
observed values for functions of these quantities related as shown by 
the various constant coefficients ci, 6, c,* • and the A^s the necessary 
adjustments. 

(2) Multiply each of the n observation equations by the coefficient 
of Qi in that equation and add the n resulting equations to obtain the 
first normal equation 

( 2 a^)Qi + (Sab)Q 2 + * * * ( 2 ak)Qk - SoX = 0 
The summations involving the A’s are zero. 


[13 a} 
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(3) Repeat step (2) ^ - 1 times, substituting in turn, however, the 
coefficients of the other Q's to obtain altogether k normal equations. 

(4) Solve the k noimal equations simultaneously to obtain the ad- 
justed values of Qi, © 2 ?* * 'Qk- 

(5) Obtain the probable errors of the adjusted quantities by applying 
Eq. 48. 

When the independently observed values Xi, X 2 , • • • have the weights 
Wi, W 2 ,‘ • •, the procedure is identical with that above, except that the 
first observation equation is multiphed by the second by W 2 j etc. 
The normal equations then have the form 

(2wa^)Qi + ('Ewab)Q2 H (Lwak)Qh — ^waX = 0 


[18] 


{i:.wak)Qi + (Ewbk)Q2 + • * • {^wk^)Qk - '^wkX =, 0 

Adjustment procedure when the quantities are nonlinearly related 
depends on the type of relationship. No general rules can be set up. 
It is necessary, in any case, to write the observation equations in such 
a form that the differences between the observed and adjusted values 
are in the same units for all the quantities to be adjusted, since the 
squares of these differences are to be added and the sum made a 

minimiTTn . 

Where all of the quantities to be adjusted or functions of them taken 
singly can be related hnearly in a single equation and where each meas- 
ured value represents a value obtained for one of the quantities to be 
adjusted, a much shortened procedure is possible. With the quantities 
or functions arranged as a sum in the equation of condition that must 
be satisfied, one substitutes measured values and computes a discrep- 
ancy which is to be eliminated. The adjustment is completed by divid- 
ing up this discrepancy among the various quantities or functions ia 
inverse proportion to their weights. 

Ta obtain the probable errors and other precision indexes of the ad- 
justed quantities (1) the solutions for the adjusted quantities, as ob- 
tained from the normal equations, are arranged for each as a sum of 
terms each consisting of an exact coefficient and a measured quantity 
with a given precision index, and (2) the principle for obtaining the 
precision index of a sum is then applied. 

PROBLEMS 

1. Find the most probable elevations of R, C, D, and E above A (the lowest) 
when the following observations are made. Assume ah determinations to have 
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probable errors of 2.0 ft. What is the probable error of the final detennina- 

tions? 

= 102 ft c - B ^ 400 ft 

C = 500 ft C - D 349 ft 

D = 150 ft D _ ^ 72 ft 

•2^ = 80 ft B - E ^ 20 H 


2. Let the observed values for the angles of a plane triangle be 60^* 10^ ± 1^, 
60° 2' ± 2' and 60° 0'± 5'. What are the most probable values of the angles? 

3. Measurements of the y-components of the separations of the star images of 
stars Of, /?, 7, and 5 (indicated in the order of increasing y) are as given below. De- 
termine the most probable values of the i/-components for these star images meas- 

. ured with respect to the image of star a. 


Distance 

Separation ( mm ) 


13-oi 0.063 ±0.005 
7-a 0.219 ±0.004 
5-a 0.250 ±0.007 


Distance 

Separation (mm) 

7-iS 0.150 ±0.003 

0.193 ±0.005 
5-7 0.041 ±0.006 


4. Given the following assumed measured values for CO 2 at 50 A and 100° C: 


Cp = (0.275 ± 0.005) cal/(gm C°) 
c„ = (0.191 ± 0.002) cal/(gm C°) 

7 = 1.417 ±0.005 

"■(■1). (s).- 

determine the adjusted values for Cp, c,,, and 7 . 

5. From direct thermal measurements, with AG representing the change in Gibbs' 
function (the chemists' free energy) for the reaction specified, the following have 
been obtained: 


(а) C 2 H 6 2C 4* SHg AG - (+8,260 ± 200) cal 

( б ) 2 H 2 + 20 C 2 H 4 . AG = (+15,820 ± 300) cal 

From equilibrium constant determinations, the following has been reported: 

(c) C 2 H 6 ^ C 2 H 4 + H 2 AG - (+23,330 ± 10) cal 

Though some uncertainty has been expressed as to the justification for adjustment 
here, we are justified in using the data conditionally. What, in view of relation c, 
are the most probable values of AG for the reactions a and bf 

6. Do the data of Table III satisfy either the Rossini and Deming or the Birge 
test for external consistency as set forth in Chapter VIII? Making use of the 
x^-procedure, determine the probability of occurrence of the values of that table 
on the assumption of an expected normal frequency distribution. 

7. Using the method employed by Darwin to obtain the needed simplified ob- 
servation equations, determine the adjusted values fot e, c/mo, aJ^d h which follow 
from standard procedure. What are their probable errors? 



CHAPTER XI 


LEAST-SQUARES EQUATIONS REPRESENTING 
OBSERVED DATA 

1. Introduction. Of the many products of least squares, that which is 
most valued is the method which it provides for the determination of 
the best equation of a specified tjqte to represent observed data. Al- 
though strictly covered above under the most general case of the Ad- 
justment of Observations, the method, because of its importance, is 
reconsidered here in a fashion more directly applicable to the determina- 
tion of least-squares equations. 

Often the constant appearing in a desired equation is important for 
the operation of an instrument or the application of a principle. In 
other instances it stands for a constant of nature and represents the 
goal of an experiment. Particularly in this latter case there seems 
justification for the accuracy which the least-squares method yields. 
Examples of such constants are the photoelectric constants V® and 
<o/e of the Einstein equation 



the first radiation constant (often called the Stefan-Boltzmann con- 
stant), <T, appearing in the fourth-power radiation equation 

In (S = In 0 - -h 4(b T) [2] 

and the gravitational acceleration of a freely falling body, g, as it ap- 
pears in the well-known equation 

ge 

s — So + -f [3] 

When one relies chiefly upon the eye in fitting a curve to plotted 
data, a tendency, difficult to overcome, is that of giving undue weights 
to the end points of the plot even though it is understood that the inter- 
mediate points are equally reliable and should be given equal weight. 
This tendency is particularly undesirable in the numerous cases where 
the extreme points are such because of added difficulties experienced m 
maldng observations in their regions and the regions beyond. By the 
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method of least squares, however, one may give either equal or unequal 
weights, as desired, to the various points of the plot. 

Granted the type of equation to be used and the weighting of the 
data, there is no prospect for the obtaining of a more satisfactory equa- 
tion than that which the least-squares method yields. There is, however, 
one drawback to its general use, and that is the great amount of labor 
which it ofttimes but not always entails. For this reason it may often 
be supplanted, with some slight sacrifice of confidence in the result, by 
one of the substitute methods of Chapter HI combined with the method 
of successive approximations. 

The method of least squares does not indicate the best form of equation^ 
whether linear, or quadratic, or of other type, for the representation of given 
data. At mosty it yields the most probable values for the constants entering 
an equation of an assumed form, whatever that form may be. In line with 
this, one sees possibilities of many least-squares equations for the same 
given set of data, each being a best representation for its own type of 
equation. Of these, the actual form selected, as noted in Chapter III, 
will generally depend upon theoretical considerations or the will or the 
intuition of the worker. 

In this chapter we discuss particularly the theory and the process for 
cases where y = f{x) takes the form of a straight line or a parabola, 
simple cases to which many others may be reduced. Shortened methods 
for special conditions, probable errors of constants determined by least- 
squares methods, and a criterion for closeness of fit of a least-squares 
equation are also considered. Special attention is directed, in case com- 
puting machines are not available, to the time saved when starting with 
an assumed approximate equation. 

2. The Straight Line with Liability of Error Limited to the Dependent 
Variable. The constant which describes the variation of the resistivity 
of a metallic element with temperature at high temperatures is an im- 
portant characteristic of the metal which helps to distinguish it from 


other metals. It is represented by 


Td^ 
p dT 


and is obtained from a plot 


of log p = / (log T). Data of this kind for molybdenum,^ as taken from 
Fig. 1 of the paper referred to, are given in Table I and Fig^ 1. 

Here we seek the least-squares equation for a straight line to repre- 
sent the data just referred to. Conveniently representing log T hj x 
and log p by y, the form taken by the equation is 


y z=z a + bx 

of which b is the constant in which we are the more interested. 


1 WortMng, A. G-, Phys . Rev ., 28, 190 (1926). 
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In accord with the least-squares principle, or, what is the same, the 
maximum probability principle, the line desired is a line characterized 
by a minimum for the sum of the squares of the deviations of the plotted 
points from it. A difficulty appears at once. Shall distances be taken 
at right angles to the line? If so, the equation obtained will apply only 
to the particular arbitrary coordinate scales selected for the figure. 
With any other selection, different values will be obtained for a and 6. 
How, in the general case with y and x differing in nature, we may select 
coordinate scales justif^dng the application of the least-squares prin- 
ciple to perpendicular distances between the plotted points and the 
least-squares line will be discussed later. 

Here, following the usual and least arduous procedure, we shall assume 
the deviations, the sum of whose squares is to be a minimum, to be 
those that are strictly parallel to the ^/-axis. This is equivalent to 
assuming that the aj-measurements are exact and that the values of the 
dependent y-variable only are liable to errors. Now the procedure is 
direct and simple. 

Where y represents values defined by the least-squares equation 

y == a + hx [ 4 ] 

and 2/oj the observed values, we seek, as in connection with the adjust- 
ment of conditioned observations (see p. 217), to minimize, with respect 
to both a and b, ^(yQ — y)^ or what is the same, ^{yo — a -- hx)^. 
Where n represents the number of observed points, all assumed deter- 
mined with the same precision, there follow 

^P(2/o -a~ hxf] = 0 [5] 

^[2(2/0 - a- hxY] = 0 [6] 

from which we obtain 

na + bl^x = Xyo [ 7 ] 

aZx + bXx^ = Xxyo [8] 

It is well to emphasize here that in Eqs. 7 and 8, the unknowns are 
d and b, and that the summations involving x and z/o are known quan- 
tities. From these equations, we obtain 

— '^xXxyo 

^ ~ tiEx^ - (Xx)^ 

b = ^^^2/0 - ^xXyo ^ 
nEx^ ^ (Xx)^ 


[ 10 ] 
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We may next proceed to tabulate the given values of x and t/o, to ob- 
tain the summations entering Eqs. 9 and 10 to solve for a and 5, and 
finally to substitute in Eq. 4 to obtain the relation sought. 

Excepting, however, certain instances where computing machines are 
available, much time may often be saved by first introducing a conven- 
ient linear relation 

2/' = a' + Vx [11] 

which represents approximately the relation sought. One then treats 
by the least-squares method the dtBFerences Ae/o between the obser^^ed 
?/o’s and the given by this assumed relation, to obtain a. relation 

At/ = Aa + Abx [12] 

The final desired relation follows at once from Eqs. 11 and 12. 

2 / = 2 /^ + At/ = (a' + Aa) + (t' .-f — a + bx [13] 

We shall follow this plan. With the convenience of dealing with small 
numbers in mind, it is often found desirable, as noted also in Chapter 
III, to replace ^ or x or both by simple functions of those variables. 
This procedure will also be made use of in what follows. 

Inspection of the x and yo columns of Table I shows that the numbers 
represented by and xyo will be unwieldy. One obvious advantage is 
obtained, as shown in the table, by making the substitution 

x' = a; -- 3.2000 [14] 

and treating the x^ of this equation as the x of Eqs. 1 J to 13. 


TABLE I 


Data Showing the Resistivitt, p, of Molybdenum as a Function of Temper- 
ature, Tj AS Used in Illustrating the Procedure Invol'v^d in Finding the 
Least-Squares Equation op a Straight Line 


T 

i ° K ) 

p 

(jxQ cm) 

(logT) 

VO 

(log p) 

(x- 3.2000)1 

(yo — yO 

10%'2 


m — y 

2289 

61.97 

3.3596 

5.7922 

+0.1596 : 

-0.0013 

25472 

-207.5 

-0.0001 

2132 

57.32 

3.3288 

5.7584 

+0.1288 

+0.0003 

16589 

+ 38.6 

+0.0014 

1988 

52.70 

3.2986 

5.7218 

+0.0986 

-0.0016 

9720 

-15S.0 

-0.0006 

1830 

47.92 

3.2625 

5.6805 

+0.0625 

-0.0014 

3906 

- 87.5 

-0.0005 

1489 

37.72 

3.1729 

6.5765 

-0.0271 

-0.0023 

734 

+ 62.3 

-0.0017 

1286 

32.09 

3.1092 

5.5064 

-0.0908 

+0.0008 

8245 

- 72.6 

+0.0012 

1178 

28.94 

3.0711 

5.4616 

-0.1289 

-0.0002 

16615 i 

+ 25.8 

+0.0001 



' ' 


+0.2027 

-0.0057 

81281 

-398. 9 

-0.0002 
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For the convenient approximate solution, we may assume (Fig. 1) 


2/' = 5.6100 + 1.150a;' [15] 

For the A^/o there follows, as also shown in the table 

Ayo = 2/0 — V = 2/0 - (5.6100 + 1.150a:;') [16] 

The quantities now subject to least-squares treatment are the rela- 
lively very small munerics x' and Ayo* 

In accord with the requirements of Eqs. 9 and 10, we next form the 
squares and the products a;'Ayo) determine the sums Sa;', SAyo, Sa;'^, 
and Sa;'A2/o, and substitute the values obtained in the equations to obtain 
Act and A6. So doing leads to 


Aa = 


Ah = 


(81281 X 10”®) (-0.0057) - (0.2027) (-398:9 X 10”®) 


7(81281 X 10”®) - (0.2027) 


= -0.0007 


7(-398.9 X 10^®) - (0.2027)(-0.0057) 
7(81281 X 10”®) - (0.2027)2 


= -0.0031 


[17] 

[18] 


There follow 


Ay' = -0.0007 - p.OOSla;' 


[19] 


y==y' + Ay' = 5.6093 + 1.1469a;' 

= 5.6093 + 1.1469(a; - 3.2000) [20] 


Eq. 20 is the least-squares equation which best represents the data of 
Table I and Fig. 1, and 1.1469 is the least-squares value found for the 
T dp 

unportant constant — — - How well the equation fits the data is shown 
p dT 

in the final column of the table under 2/0 — 2/* .That the two end dif- 
ferences should be the smallest is a matter of chance. The close agree- 
ment leaves little doubt as to the correctness of the assumption that 
Tdp . 

- — IS a characteristic constant. Just how much of the 1.1469 is 

p al 

significant cannot be stated without the treatment of more experi- 
mental data. Without doubt the 9 is without real significance. 

With weights assigned, wi for point 1, 1^2 for point 2, etc., the pro- 
cedure is very similar to that described. Corresponding to xi, we then 
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Fig. 1. GrapL of log resistivity of molybdenum as a fimction of log temperature. 
The dashed line represents the assumed convenient approximate relation. The 
XX points represent the differences between observed values and those predicted 
by that assumed approximate relation. The line Ayo ~ f(x) represents the least- 
squares relation for those diifferences. The full line y — f(x) represents the least- 
squares relation for the original data. 



3. Procedures Leading to Shortened Computatioiis. Often, but not 
always, the labor involved in least-squares computations may be re- 
duced appreciably or greatly by following certain procedures. At least 
four possibilities may be named. Two of them have already been illus- 
trated in the preceding section. The first consists of introducing new 
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variabies to take the place of those given in the original data. Referring 
to the preceding section, note that the independent variable T was re- 
placed by log T - 3.200 and that p was replaced by log p. The gain 
has been twofold, that of obtaining a linear form for the function and 
that of obtaining numbers with reduced magnitudes with which to deal. 
As vill be noted in a later section, such a change for the dependent 
variable involves a change of weight. This change, really rather 
unimportant for the case illustrated, was ignored in the application 
referred to. 

The second procedure, also illustrated above, consists of assuming a 
convenient approximate relation between the two variables, taking the 
differences between the observed and the resulting corresponding com- 
puted values of the dependent variable, and applying the normal least- 
squares procedures to such differential values. See in this connection 
Eqs. 15 and 16 above and the column of Table I headed A^/o* The gain 
has been a very considerable reduction in magnitude of the numerics 
involved. 

The third procedure consists in making slight adjustments to yield 
values for the dependent variable corresponding to more convenient 
rounded values for the independent variable. In niaking such adjust- 
ments, the definite trend of the relation should be observed. How this 
may be done and the gain obtained thereby is well illustrated in Table 11. 
A rough plot of the data indicates a straight-line relationship with an 
expected rate of variation of with pressure of about 1.34 X lO”^ 
K°”^/mm-Hg. Applpng this common rate to all values of a,,, the 
indicated adjusted values follow directly. When, further, the first two 
named procedures are applied in addition, the problem of finding the 
desired will be found to be quite brief and simple. The carrying 
through of such a computation is left for a problem to be found at the 
end of the chapter. To what extent adjustments of this type may be 
safely made may well be left to one^s common sense. Any error intro- 
duced on this account into the result for the case considered is obviously 
inappreciable. 

The fourth procedure consists in taking or selecting data in advance 
for least-squares treatment in such manner that successive values for 
the independent variable shall differ by the same constant amount, say 
10 cm, 5 min, 40 ft/sec, etc. This procedure is only applicable where 
the dependent variable may be equated to a polynomial such as 

y = a + bx + cx^ + dx^ 

involving the independent variable only to the third power (at present) 
or less. When such is the case, it is possible, with change of variable, 
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TABLE II 

Portion of Data Reported by Beattie,^ of IMassacbtctsetts Institute of 
Technology in a Determination of the Constant Volume Coefficient 
OF Nitrogen at 0® C and Zero Pressure and Certain Adjustments of That 
Data to Yield More Convenient V vlues for Least-Squares Treatment 


Unadjusted 

Adjusted 


10^ av 

V 

10' av 

mm-Hg 

jjo-l 

mm-Hg 

’rA 

1 

o 

998.28 

36740.48 

1000.00 

36740.71 

749.66 

36707.01 

750.00 

36707.06 

599.59 

36686.30 

600.00 

36686.36 

449.42 

36666.57 

450.00 

36666.65 

333.11 

36651.84 

330.00 

36651.40 


1 Beattie, James A., Report on the Thermodynamic Temperature of the lee Point, from a symposium 
on Temperature, Its Measurement aiid Control in Science and Industry, New York, The Reinhold Pub- 
lishing Corporation, 1941, p. 85. 


to make use of the procedure developed by Baily and the tables com- 
puted by Cox and Matuscbak whose uses are described below. 

4. Nonlinear Forms of Equations That May Be Readily Reduced to 
Linear Forms for Least-Squares Treatment. Of these we cite Cauchy’s 
two-term equation for the index of refraction of a substance 


b 

[24] 

the common decay law 

[25] 

I = loe- 

the normal frequency distribution of errors 


y = 

[26] 


the law for the variation of field strength m the neighborhood of an 
infinitely long, uniformly charged circular wire of unknown diameter 

E{t + a) = b [2/] 

and the potential energy for a system of two bodies expenencmg mu- 
tually attracting and repelling forces 

V = ar~^ — 6r” 


[ 28 ] 
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The first of these is actually linear in n and 1/X^ though not in n and X, 
The others may be changed to the following forms for convenience: 


In / = In Jo olx [29] 

In ?/ = In 2/0 ~ [30] 

I = r + a [31] 

a- [32] 


in which forms the equations are linear in terms of the functions multi- 
plying the constants sought and may be treated accordingly. 

5. The Straight Line through the Origin, y = bXj with y Only Liable 
to Error. Sometimes y is known to be proportional to x. Then the best 
value for the single constant h in the relation 

y = bx [33] 


is to be determined, 
where 


This is the case for the radiancy of a black body 


(R =aT^ 


[34] 


which takes the form of Eq. 33 when is represented by x. Here we 
imagine plotted as abscissas and (R as ordinates. The procedure 
outlined above, on the assumption that a is zero, and that y, or (R, only 
is liable to error, leads to a simple expression for b, , 

Substitution of a = ‘o into Eqs. 7 and 8 leads to two expressions for 
b, namely 


and 



The former depends on the partial derivative of a summation with 
respect to a and is meaningless here since a is a constant and no such 
partial derivative is possible. The latter, however, depends on a deriva- 
tive with respect to b of the summation ^(yo — bx)^ based on the con- 
dition that a is zero. It gives a best value for b for the condition that 
the graphed straight line must pass through the x, y origin. Cor- 
responding to the original specified condition, Eq. 35a is the one to be 
used. 

For xmequally weighted pairs of values, we have 

'^wxyo 


[ 36 ] 
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For the constant (t, we have accordingly, for the case of equal weights 
given to observation equations of the type of Eq. 34 


2(r4)2 


[37] 


Eq. 35a forms the basis for much work in Correlation. (See Chap. 

XII.) 

6. Change of Weights Implied by a Change of Variables. Instead of 
following the procedure outlined in the preceding section for obtaining 
a most probable value of the first radiation constant o-, at least tw^o other 
reasonable methods may be follow^ed to yield least-squares values. The 
three methods will normally yield different best values unless account 
is taken of the variation in method. 

First, let Eq. 34 be rearranged to read 


Ind? = hi(r + 4In r 


[38] 


We may imagine In cH as the dependent variable plotted as a function 
of In T, the indejpendent variable whose values, as those for in the 
preceding section, we shall treat as free from error. 

Accordingly we seek the least-squares line whose slope is 4, and in 
particular its intercept on the In (R axis. Equating 6 of Eq. 7 to 4, 
yields 


whence 


St/o “ 


= ln' 


'Sln (H -4Elnr 
n 


[39] 

[40] 


a value which is also obtained by merely averaging the values of In or 
as given by Eq. 38 and then taking the antilog. 

Second, we may rearrange Eq. 34 to read 


^4 


= O' + 0 =0' 


[41] 


Similarly, we may imagine (R/T^ the dependent variable plotted as a 
function of the independent variable 1/T^ which is assumed free from 
error. Now we seek the intercept for the least-squares line with a zero 
slope. Equating the 6 of Eq. 7 to zero leads at once to 


or 


o = - S2/0 
n 


is- 


[42] 

[43] 
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This value is a straight average of the dependent variable. The solution 
obtained by equating the b of Eq. 8 to zero is to be disregarded for a 
reason similar to that given in connection with Eq. 35. 

That the procedures based on Eqs. 34, 38, and 41 will lead to different 
values for O' is evident. The explanation is that they tacitly ascribe 
different weights to the observed pairs of (R, T values. Assuming values 
for T precise, consider what changes in weights have been tacitly given 
to the measurements of (R in shifting from the procedure based on Eq. 
34 to that based on Eq. 38. The answer is indicated by Eq. 33 of Chap- 
ter IX which expressed the law of propagation of probable errors and 
other precision indexes for the general case. Simplified for the present 
case of only one independent variable, it states that 

d(ln (R) 1 

Vln(R = — ; P(R = -V(R [44] 

d(R (R ^ 

Since weights vary inversely as probable errors squared, we have 

_ {V(r/ CR)2^ _ VcR^ 

(^ln^)2 (^2^P(R^ 

Assuming that all p^jj^s are equal, this means that the corresponding 
values of hi should be weighted as the squares of their own If 
such weighting is applied when starting with Eq. 38, and one is able to 
consider the fractional deviations {(R — (Rq)/(R — (R represents a least- 
squares curve value and (Rq 2 ^ corresponding observed value — so small 
that their second order effects may be ignored, it is possible to show that 
the <r obtained is the <r of Eq. 37. To the extent that those second 
order effects, namely those due to the higher order terms ignored when 
In [1 — (d? — d?o)/d?] is replaced by {(R — (R^^/Gi in the series expan- 
sion, are not negligible, the cr's based on Eqs. 34 and 38 will differ. 

In accord with the above, when the shift was made above to Eq. 40 
and its In cR's were treated as equally weighted, the weights tacitly given 
to the (R's (not In CR’s) varied as 1/(R^. 

Similarly consider the weights tacitly given to the measurements of 
(R when the procedure initially based on Eq. 34 was changed to that 
based on Eq. 41. Here we obtain 

d(CR/T^) 1 

Pm = -- - P(R ^Y^P(R 

and 

_ {p<r/T%^ ^ p^ 

K^/r^)]2 {Pm/T%^ 


[46] 

[47] 
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Assuming as before that all are equal, means that corresponding 
values for (R/T^ should be weighted according to their own T^. The 
weights tacitly given to values of m (not when the shift was made 

above to Eq. 41 were as l/T^. That weighting (R/T"^ as indicated above 
actually gives the same value for a as does Eq. 37 may be shown. With 
such weights given, as may be verified with the aid of Eq. 7 modified 
to include weights, we have, corresponding to Eqs. 42 and 43 

'Zw(R/T^ 

a = — [48] 

2^W 

<r = [49] 


2^8 




the latter of w-hich is identical wdth Eq. 37. Equivalence for the end 
results may be shown but not so simply when the first and second pro- 
cedures are similarly tested. How^ever, the conclusion follow’-s that with 
proper accoxmt taken of changes in weight for the dependent variable, 
it matters not, where only one constant is involved, in which of many 
interchangeable forms the data are given least-squares treatment. 

The foregoing does not indicate in any way that, in an actual deter- 
mination of cr, equal weights should be given to the (R's rather than the 
In ^H's or the cP/T^’s. 

7. Probable Errors for the Least-Squares Constants of a Linear 
Equation Obtained from a Set of Equally Weighted Points. Here one 
may follow the procedure of section 6 of Chapter X, p. 229, for obtaining 
the probable errors of adjusted measurements. In so doing, he should 
note that the symbols of this chapter w-hich correspond to Qi, Q 2 , a, b 
and X of Chapter X in order are a, b, 1, a: and y. For the least-squares 
straight line, that treatment yields 


1 

[50] 

- (Sxf 

1 ^ 

[51] 


If pyo is not known, it may be computed, using the defining equation 


= 0.675 


4 




hz)^ 


n — 2 


= 0.675 ' 




hx)^ 


[52] 


Expressions for pa and ph not involving pyo may be obtained by com- 
bining Eqs. 50, 51 and 52. More simply they may be obtained by 


1 See footnote on page 167. For the more precise form, the factor n — 2 replaces 
the more common n — 1, The reason is due to the fact that two arbitrary parameters, 
a and b, are involved. (See Birge, Phys. Rev., 40, 207 (1932).) 
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applying directly the defining equation for a probable error, Eq. 24 of 
Chapter VIII, p. 194. Assume that n straight lines are drawn to con- 
nect the n observed Xi yi points with the point x that the probable 
errors for the ui and hi for these lines are proportional to l/{xi — x) 
and thus that the weights to be attached to the and the hi vary as 
(xi — One then obtains for a and h the values given in Eqs. 9 and 
10. Applying Eq. 24 of p. 194 for the case of 2 / 0 ’s of equal weight 
(n^ = etc.) we then obtain 


Pa = 0, 


.675 J- 

\ ^ 


and 


Ph 


= 0.675 


/ 1 

x:^y^ — 2xyxy + x\^ , 

'71-2 

L x^ — X J 


- f 

n — ^ 


-b^ 


[53] 

[54] 


8. The Parabola, y = a + bx + c:^ with y Only Liable to Error. 
The procedure here is quite like that for the straight line. The assumed 
equation is 


There foUow 


y = a -\-hx + cx^ 


[55] 


^ [ 2 ( 2/0 — a — bx — ca:^)^] = 0 


d 

^ [ 2 ( 2/0 — a — bx — cx^)^] =0 [56] 

s 

T P(2/o — a — bx ^ cx^)^] = 0 


an + h'Ex + cEx^ = ZyQ 

aZx + bl^x^ + dEx^ = Exyo [ 57 ] 

dZx^ + hEx^ + cEx^ = Ex\q 

I [-Zx^-Zx* - (Zx^f]Zyo - [SxZx^ - Zx^Zx^]Zxyo ] 

i + [ZxZx^ - {Zxy \Zx^^{ 

I [Zx^Zx‘^ - (Zx^)2]n - [ZxZx^ ZA^]Zx j 

[ + [2a;Sa;2 - {Zx^J^x^] 

i lZx^Zx^ - 2xZx^]Zyo - [{Zx^^ - nZx^]Zxyo ] 

i ^ ^ ! + i'^xZa? — nZx^lZx^yo ' 

ilZx^Zx'^ - (Zx^y'^Jn - [2xZx^ - Z3^Zx^]Zx 
^ + [2a;2a:3 - iZx?f\Zx\ 


[ 58 ] 
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f [-SxZx^ - (Sa:2)2]S2/o - [nZx^ - ZxSx^]Sxpo 1 

_ i + [wSx^ - (Sa:)^]23:^;/oJ 

^ " f I2x^2x* - (Sx^)^]n - [2xXx^ - i:x^2x^]2x 1 

I + [SxZx^ - {-Zx^f]23^l 

The denominators for the last three equations are identical. 

Excepting certain, types of cases as will appear in a later section, the 
least-squares method for equations other than the straight line are gen- 
ally quite laborious. Here, however, much more than in the straight- 
line case, much time is saved if a convenient approximate solution is 
assumed and the least-squares principle is applied to the differences be- 
tween the observed values and those predicted by that assumed relation. 

9. Application of the Least-Squares Parabolic Equation to the 
Smoothing of Tabulated Data. In Chapter I it was indicated that a 
certain smoothing relation (Eq. 1) w^as based on the least-squares prin- 
ciple. It is now possible to show how the equation, namely 

y = ^ [172/0 + 12(2 /+i + y-i) - 3(2/+2 + y-2)} [60] 

00 

may be derived. Here yo is the tabulated unsmoothed value correspond- 
ing to xo- Similarly y^ 2 } V+i) V-u y ^2 ^^e the tabulated unsmoothed 
values corresponding to Xq + 2Aa;, xq + Ax, xq — Ax, and xq — 2 Ax, 
and y is the smoothed value, which is to replace ^o- Only five points on 
an assumed plot representing the data are used. 

For the process of smoothing at any particular x, say Xq, much time 
is saved by a change of coordinates. Let x be replaced by x' [= (x — 
xo) /Ax]. In the new coordinate system, the points to be treated are 
(2,2/+2), (l,2/+i), (0,2/o), (-2, 2 /^ 2 ). The least-squares 

relation sought is 

y ^ a + hx^ cx'^ [61] 

Since we are concerned only with the smoothed value for y at xo, we 
need only to evaluate a of Eq. 58, which is the smoothed value sought. 
Evaluation, seeming long at first sight, is actually made^short by the 
change from x to x' and y to y'. It will be found that Sx == Ex — 0, 
that Sx'^ - 10, and that Ex'^ = 34. There foUows 

- ( 34 OE 2 / - OExV - 100Ex^%) j^g2] 

^ “ (340 X 5 - 0 X 0 - 100 X 10) 

= ~ [17^/0 + 12(2^4.1 + y-i) “ + 2/-2)] [63] 

35 

which is the relation sought. 
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10. The Polynomial with jc-Values Equally Spaced and Exact. A 

most comprehensive study of this particular field has been presented by 
Birge/ Condony and Birge and Shea.^ A generalized, compact formula 
developed by them is presented in the paper last referred to. It will be 
discussed later. First, however, we shall discuss certain results and pro- 
cedures w^'Mch by virtue of the computations reported by Baily ^ and by 
Cox and Matuschak ® are more readily applied. 

The treatment of polynomials here given refers only to equations of 
the form 

y a -{‘ix + cx^ + dx^ [64] 

Further the assumption is made and if necessary the data are so manip- 
ulated (1) that the observed values of y are equally weighted, (2) that 
the successive values of x differ by a constant, (3) that the values of x 
are exact, and (4) that the values of x are arranged symmetrically with 
respect to a central value. Illustrative of the simplifying effects of 
these conditions, it has already been shown in the preceding section 
that, under the stated conditions, the rather formidable general expres- 
sions for the constants a, 6, and c (Eqs. 58) of the least-squares equation 


for the parabola 


y =: a + bx cx^ 


[55a] 


reduces to rather simple expressions. 

Treatments in accord with the above-stated conditions usually require 
a change of independent variable from x to X. Thus, where x represents 
one-half the sum of the initial and final values of Xj Ax is the common 
a:-interval, and the number of pairs of values is odd, X is defined by 


Ax 

In case Ti ls even, X is similarly defined by 

x-x 
" Ax/2 


[65] 

[ 66 ] 


Thus defined, both X^ and X^ are whole numbers with both negative 
and positive values. For_the odd series the values are 

-2, ~1,0, +1, +2, +3, +••• 

for the even series 

5,~-3,~l,+l,+3;+5,+ --- 

^ Birge, P%s. Re?;., 13, 360 (1919). 

^ Condon, E. U., Univ. Calif, Pub, in Math., 2, 55-56 (1927). 

^ Birge, R, T., and Shea, J. D.; Ibid., pp. 67-116. 

^ Baily, J. L., Ann. Math. Statistics, 2, 355 (1931). 

®Cox, G. C., and Matuschak, Margaret, J. Phys. Chem., 46, 362 (1941). 
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A simplification of Eq. 58 follows because now all summations of odd 
powers of X are equal to zero. As a result the a, h, and c of Eq. 58, 
now the a' , b', and c', of an equation in X similar to Eq. 55a, reduce to 

^ , SX2 ^ 

nSX* - (2X^)2 nSX^ - (SX^)^ ^ 

= ksZy - hZX^y [67] 

^ nSX^SX^ - (SX2)3 ^ *2SXy [68] 

/ ^ 'V ^"2 2X‘*' ^ 

^ nSX^ - (SX2)= ’ ^ ^ “ nSX^ - (SX^)' •' 

= fcsSX'j/ - AiSy [69] 

The fe’s are seen to be functions of X only and as such have been tabu- 
lated by Baily not only for the polynomial ending with X^ but also for 
polynomials ending in X and X^. The various entering and their 
designations by subscripts are shown in Table VI of Appendix 2, and 
values for these fc’s, as computed by Cox and Matuschak, for 2 < ti < 51 
are presented in Tables VII and VIII. Though given to eight significant 
figures in these two tables, usually a much smaller number will sufBce. 
"f^ere the tables are applicable, computations are very greatly reduced 
by their use. 

Illustrating the applicability of the method, let us consider certain 
data concerning a laboratory experiment relating to gra\dtational accel- 
eration published by Pugh.^ Though originally presented for least- 
squares treatment by a different procedure, they suffice well for our 
purposes. Using a falling-body apparatus with spark recording of 
positions at the ends of successive 1/30 sec intervals, the data given in 
the first two columns of Table III were obtained. The equation relat- 
ing distance and time is 

s = So + vot-\- ‘ [3] 

in which s and t replace the y and x of the preceding discussion. In 
accord with Eq. 66, the origin for the time axis is shifted to midway 
between the* ends of the 7th and the 8th tune intervals, and the interv al 
of time that corresponds to a change of 1 in X is 1/60 sec. In the new 
coordinate system, in which t is replaced by t -f- XAt/2, Eq. 3 becomes 

s = (§0 + vqI + ^gP) + (2^oA^ + ^giAt)X + [^9iAt)^']X^ [ 70 ] 

The successive terms in parentheses in order correspond to the a', 6', and 
c' of Eqs. 67 to 69 and Table VI of Appendix 2. Since the acceleration g 

1 Pugh, E. M., Am Phys. Teacher, 4, 70 (1936). . 



254 LEAST-SQUARES EQUATIONS REPRESENTING OBSERVED DATA 


TABLE III 

Illustration of the Application of Baily’s and Cox and Matuschak's 
jMethod to Falling-Body Data Presented by Pugh ^ for Use in Determining 
THE Gravitational Acceleration g 


t 

in units of 
1/30 sec 

5 

in cm 

Z 

Xh 
in cm 


1 

11.86 

-13 

2,004.34 

c' = 

2 

15.67 

-11 

1,896.07 

h = 21,462,912 X 10-12 

3 

20.60 

- 9 

1,668.60 • 

kA = 13,950,893 X lO'W 

4 

26.69 

- 7 

1,307.81 

— 1 . 40585 cm 

5 

33.71 

- 5 

842.75 

k^s = 1.26993 cm 

6 

41.93 

- 3 

377.37 

c' = 0.13592 cm 

7 

51.13 

- 1 

51.13 

Ai = sec 

8 

61.49 

+ 1 

61.49 

8c' cm 

9 

72.90 

3 

656.10 

^ ==77;^ = 978.6 — 
{Xtr sec^ 

10 

85.44 

6 

2,136.00 

11 

99.08 

7 

4,854.92 


12 

113.77 

9 

9,215.37 


13 

129-54 

11 

15,674.34 


14 

146.48 .. 

13 

24,755.12 


Totals 

910.29 


65,501.41 



1 Am . Phys . Teacher , 4, 70 (1936). 


only is desired, it suffices to solve for c', using the tables, and then for 
g, whose value is given by 


8c' 

^ “ (AO" 


[71] 


Some of the details are shown at the right in Table III. As is evident, 
the procedure is not unduly prolonged. 

In many instances data that may well be given least-squares treat- 
ment similar to that above are subject to the theoretical condition that 
the constant a of Eq, 64 is zero. One may be tempted to meet this 
difficulty in the application of the Cox and Matuschak tables by dividing 
both sides of Eq. 64 by x, treating as z in the equation 

z = h + cx + dx^ • [72] 

and then finally returning to the original form of Eq. 64. In so doing, 
however, the original 2/"Values will no longer have their original equal 
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weights, but instead will be tacitly given weights proportional to their 
corresponding rc^^s. Tables similar to those by Cox and Alatuschak 
computed for the case of a = 0 would be much appreciated. 

Consider next the more general formula of Birge and Shea, already 
referred to. Their form for the pol5Tiomial equation of the jth degree is 

y ~ ^oi + + (i2p^ >f. . . . [73] 

Curiously, all coefficients, Uoy -a/y, can be worked out as definitely 
related to final coefficients of the form ajj of which the j is not always 
the j of the polynomial sought. For the coefficient ayy they found 

(2^^-y)!(2i+ 1)! hr+{-lYy-r 

"--(2^.+y + l)!0•!)^.4^4 Z 

^ (u-r- s)!(2i« -y)!(y- s)!(s!)^ 

where n represents the number of observations, u equals ”” 1)? 
and r and a are parameters with successive values differing by unity. 
For n odd, the lowest value of r is 0; for n even, 3^. In case j is even 
and r is 0, but for no other case,- the central member of the above ex- 
pression for ajj is 2/0 rather than the expected 22 / 0 . 

For the condition j = 2, the coefficient a 22 may be obtained from a 
direct application of the above equation, and the remaining coefficients, 
aQ 2 and ai 2 , may be determined from the following 

^2 

ao2 = cioo ^22 ["^^1 

and 

ai2 = 0^11 

For other values of j the reader is referred to the original paper. 

11. Least-Squares Procedure for Relations Other than Those Ex- 
pressible in Power Series. Generally, a procedure involving an assumed 
approximate relation as illustrated above for a simple straight line will 
simplify and considerably shorten the computations connected with 
many least-squares determinations. In fact, in some instances, pro- 
cedure is extremely difficult or even stopped where such advantage of 
an assumed approximate relation is not taken. This is the case where 
the equation does not form or cannot be converted into a power series 
with the constants sought or some functions of them as the coefficients 
of the power terms. Illustrating such a relation, we have y 

y = a sin (c*?^ + &) 


[76] 
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with a and h to be determined. This relation will be treated in some 
detail in the following section. Another relation is 

y = a + ~ [77] 

with a, b, and c to be determined. 

Let y = f(x) be a desired relation of known form involving undeter- 
mined parameters a, b, o, etc. Let y' = i{x) represent the approximate 
equation. We may write, in accord with Taylor's expansion 

= = + + PS] 

In evaluating the partials, as suggested by the primes, the assumed 
values of a, 6, c, • • •, as expressed my' = f{x) are used. To illustrate, 
where y — f(x) takes the forms of Eqs. 76 and 77, we are able, using 
the approximation principle, tc reduce the problems to finding the con- 
stants Aa, Ab, and Ac for the following: 

Ay = sin -f t') X Aa -f o' cos (cot -b b') X A6 [79] 

■ A A 1 1 A , b'\a.x 

Ay = Aa + ^Ab- Ac [ 80 ] 

The quantities o', b', and c' are constants, obtainable by one of the 
methods of Chapter III. The equations are linear in Aa, Ah, and Ac 
and are subject to standard least-squares treatment. Since the partial 
derivatives involve o', b', or c', it is of importance that the assumed 
relation shak approximate the final relation rather closely. If the first 
approximation is not sufficiently close, a second may be required. 

3 d 6 lding Aa and Ah of Eq. 79 are obtained in a manner 
similar to that 3delding Eqs. 9 and 10, from which a and b were obtained 
in the straight-line case. The equations obtained are also similar. 
Where three corrections, as Ao, Ab, and Ac, are involved, the procedure 
is like that described above for the parabola, and the equations have a 
certain similarity. 

Once Aa, Ab, Ac, •• ■ have been determined, the corrected values for 
a,b,c,--- are obtained readily, since they are merely a' + Aa, V -f- Ab, 
c' -b Ac, • • • 

12. The Sine Curve with Angle Measurements Free from Error. 

The procedure which we shaU Mow here will differ slightly from that 
suggested in the preceding section. It will be simplified to the extent 
that we shaU assume an approximate value for the b but not for the a 
of Eq. 76. 
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TABLE IV 

Showing a Convenient Form for IVIaking Computations, and Sample Compu- 
tations Leading to a Least-Squares Equation of the Form 2/ = a sin (wI - €) 
IN Accord with Eqs. 81 to 86 

(Certain of D. C. Miller s ether drift data ^ interpreted as showing azimuthal angu- 
lar motion wth respect to the ecliptic are here used. As 0.15 X 360° has been 
chosen. 


t 

sidereal 

day 

e 

deg 

Vo 

deg 

cos 6 

sin 6 

y(r 

deg2 

Vo cos 6 
deg 

2/0 sin 9 
deg 

j 

cos 5 sin 0 

cos2 0 

0.00 

-54 

-25 

0.588 

-0.809 

625 

-14.70 

20.22 

-0.4757 

0.3457 

0,05 

-36 

-26 

0.809- 

-0.5S8 

676 

-21.03 

15.29 

-0.4757 

0.6545 

0.10 

-18 

- 4 

0.951 

-0.309 

16 

- 3.80 

1.24 

-0.2939 

0.9044 

0.15 

1 ■ ^ 

7 

1.000 

0.000 

49 

7.00 

0.00 

0.0000 

1.0000 

0.20 

IS 

6 

0:951 

0.309 

36 

5.71 

1.85 

0.2939 

0.9044 

0.25 

36 

13 

0.809 

0.588 

169 

10.51 

7.64 

0.4757 

0.6545 

0.30 

54 

30 

0.588 

0.809 

900 

17.64 

24.27 

0.4757 

0.3457 

0.35 

72 

•26 

0.309 

0.951 

676 

8.03 

24.73 

0.2939 

0.0955 

0.40 

90 

32 

0.000 

1.000 

1,024 

0.00 

32. OG 

0.0000 

0.0000 

0.45 

108 

40 

-0.309 

0.951 

1,600 

-12.36 

38.04 1 

-0.2939 

0.0955 

0.50 

126 

32 

-0.588 

0.809 

1,024 

-18.82 

25.89 i 

-0.4757 ^ 

0.3457 

0.55 

144 

21 

-0.809 

0.588 

441 

-16.99 

12.35 i 

-0.4757 

0.6545 

0.60 

162 

11 

-0.951 

0.309 

121 

-10.46 

3.40 i 

-0.2939 

0.9044 

0.65 

180 

- 5 

-1.000 

0.000 

25 

5.00 

0.00 

0.0000 

1.0000 

0.70 

-162 

-16 

-0.951 

-0.309 

256 

15.22 

4.94 ' 

0.2939 

0.9044 

0.75 

-144 

3 

-0.809 

-0.588 

9 

- 2.43 

-1.76 

0.4757 

0.6545 

0.80 

-126 

-21 

-0.588 

-0.809 

441 

12.35 

16.99 

0.4757 

0.3457 

0.85 

-108 

-22 

-0.309 

-0.951 

484 

6.80 

20.92 

0.2939 

0.0955 

0.90 

- 90 

-29 

0.000 

-1.000 

841 

0.00 

29.00 

0.0000 

0.0000 

0.95 

-72 

-32 

0.309 

-0.951 

1,024 

- 9.89 

30.43 

-0.2939 

0.0955 






10,437 

-22.22 

307.44 

0.0000 

12.0004 


1 10437 X 12-0004 - (-22.22)2 , 

- deg = 34.09'^ 

A 307.44 X 12.0004 - 0.0(-22.22) 


10437 X 0.0 - (-22.22) (307.44). 
10437 X 12.0004 - (-22.22)2 


rad = 0.0543 rad = 3® 7' 


e' + S = 54° + 3®7' = 57®7' ‘ 

f 300® \ 

y* 34®5.4'Bm — £-57®7'l 

\sid. day / 


iBev. Modern Phys., 6, 203 (1939). 
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Assume the desired form of equation to be 

y = asin (o)t — e) [81] 

where a and e are to be determined. From a plot of the data, estimate 
in advance, as is usually possible, an approximate value for e, say e'. 
Let S represent (e — e'); 6, the angle (oit — e'); and A, the term 1/a. 
Expansion of sin — 5) in terms of sines and cosines leads at once to 

Ay — sind + 8 cos 6 = 0 [82] 

In determining the least-squares equation, A and 5, in terms of which 
the equation is linear, are to be evaluated. Regular procedure yields 

- sin <9 + 5 cos 0)^ = = a minimum [83] 

of which t/o represents measured values corresponding to appropriate 
values of 6. Equating d(j)/dA and d(j)/d8 separately to zero and solving 
for A and 8 as before, leads to 

A'Zyo^ — S^/o.sin 6 + 8hyo cos 0 = 0 

A'Eyo cos i9 — S cos 6 sin 6 + cos^ 0 = 0 

^ _ St/o sin 6 E cos^ 0 — S cos 0 sin 0 S 2/0 cos 0 
cos^ 0 — ( 2 ) 2/0 cos 0)^ 

^ ^ 'Eyo^'E cos 0 sin 0 ~ St/o cos 0 Eyo sin 0 
S 2 /o^ 2 ) cos^ 0 — (Eyo cos 0)^ 

Insertion of values for A and 8 in Eq. 82 gives the relation sought. Id 
case the first estimated e' yields too large a 5, repetition of the process 
with a different e' will be necessary. Table IV, which deals with a 
simple case, shows a convenient form for carr 3 dng out the computations. 
Probable errors for a and € may be obtained by following a procedure 
much like that for the probable errors for the constants a and 6 of a 
straight-line equation. 

13. The Least-Squares Equation of the T 3 q)e y = a + bx when 
Liabhity of Error Occurs with Both x and y. Although mathematically 
we may consider , x an independent variable with values arbitrarily 
chosen and as such not liable to error, in reality in physical problems, 
such is not always the situation. Frequently neither x nor y can be 
said to be more independent as a variable than the other. Both are 
measured and the values obtained for both are subject to errors of meas- 
urement. Consider the case of the measurement of the temperature and 
the radiancy of a black body for some particular condition of operation. 

Such is the Justification for that which follows. 


[84] 
[84a] 

[85] 

[ 86 ] 
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Since x and y will generally differ in ph3^sical nature, it is necessarj^ 
to treat certain simple functions of these variables rather than x and y 
themselves. These functions must be either dimensionless or expressible 
in the same physical units. Otheivdse there seems to be no logical way 
of properly weighting them. Starting with 


y a + hx [87] 

as the relation sought, we first express x and y^ in effect, in terms of 
their probable eri-ors as units, writing 


Vy — a + b'px 
Py Px 

Then dividing through by a, we have 

iSF' = l + aX' 


[ 88 ] 


[ 89 ] 


where a, 13, X', and 7' stand in succession for bpx/a, Py/a, x/px, and 
y/Py. All quantities are now dimensionless and the probable errors of 
both X' and 7' are unity. 

Imagine a plot showing 7' = /(X') with the same scale (this is im- 
portant) for both X^ and 7'. The problem is now resolved to that of 
finding the straight line to which U, the sum of the squares of the 
perpendicular distances from the points to the line, is a minimum. 
Standard procedure, using observed values for X' and 7', yields 




(1 + aX' - 

+ 


[ 90 ] 


Application of the least-squares principle, namely, that the partial de- 
rivatives dU/da and dU/dfi shall be separately equal to zero, yields 
equations which are to be solved for a and j8. If then a, /3, X', and Y' 
are replaced by their equals in terms of a, b, x, and y, one obtains ex- 
pressions which may be solved to yield the desired values for a and 6. 
Differentiations of Eq. 90 with respect to a and to jS separately yield on 
shght rearrangement. 


2:[(i+«^'-^n(f-^+f)]-o [91] 

2;[(1 + +5 + f )]-0 [ 92 ] 


and 
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Combining Eqs. 91 and 92, keeping in mind that the summation process 
prevents equating the indicated factors separately to zero, we obtain 

S(1 + aX' - / 3 F) = 71 + aSX' - / 5 SF' = 0 [93] 

Replacing a, /3, X' and Y' by their equivalents and solving for a, one 
obtains 

a = - bZx) [94] 


Similar treatment of Eq. 91, together with the elimination of a by means 
of Eq. 94, leads to a second-degree equation in 6, namely 


62 + 6 - nHx^] - [(Sy)^ - nSy"] 

— nZx^ 



[95] 


Eqs. 94 and 95 may be solved to yield the desired a and b. For values 
of px small in comparison to p^, the value of b reduces to that given by 
Eq. 10, which was derived for the case where y only is liable to error. 
Similarly the value for a reduces to that given by Eq. 9. 

Though occasions justifying the application of Eqs. 94 and 95 occur 
rather often, their use seems to be very infrequent. 

14. Criterion for Closeness of Fit. When one determines by the least- 
squares method an empirical equation of the form, say 

y = a + bx-F C3? [ 55 a] 

to represent observed data, certain questions sometimes rise. For in- 
stance, is the cx^ term necessary? Or, should another term dx^ be added? 
It is obvious that, if is a single-valued function of x, and there are n 
pairs of values given, an equation similar to Eq. 55a containing n terms 
on the right-hand side with n arbitrary constants could be derived which 
would fit the data exactly. Nevertheless, the data may not justify the 
use of more than two or three terms of the power series. For the deci- 
sion, a criterion is needed. That which is used, except for certain simple 
cases, is based on Gauss’ mean-square deviation. 

A simple case, such as has just been referred to, arises sometimes when 
the data, y = f{x), are in tabular form with values of y tabulated to 
correspond to equal intervals of a:. As indicated in Tabid II of Chapter 
III, the successive differences may then indicate the form of equation 
w^ch will represent the data suitably. In particular, if the successive 
^erences of the nth order of y ior a constant Ac are constant or vary 
therefrom but slightly and then only in a haphazard manner, the J(x) 
takes the fonn of a polynomial in a: with n as the highest exponent. 
Accordmgly, where the original data are such as to yield tabulations 
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of the type referred to, successive differences may indicate Just how many 
terms of a polynomial are justified. Where such is the case, this pro- 
cedure of obtaining successive differences is the simplest for determining 
how many terms shall be included in the f(x) pol^momial. On the other 
hand, such successive differences may leave some uncertainty as to where 
approximate constancy actually occurs, and there may then be need of 
a more positive test as to the number of terms for the best pol^momiaL 
Of course, this simple, test is not applicable at all where the y-vshies do 
not correspond to x-values at regularly spaced intervals, or where the 
equation actually representing the data does not belong to the group 
of equations which can be tested in this manner. 

The Gauss criterion states that the closest fit is possessed by the 
equation that yields a minimum for the quotient obtained when the 
sum of the squares of the deviations (or residuals) of the obsen^ed from 
the computed values for y is divided by the number of observed pairs 
of {x,y) values less the number of arbitrary constants involved. In 
equation form, with n as the number of observed pairs and m the number 
of arbitrary constants or free parameters, the criterion is 

Q y)— == 0^ Tnininnim [96] 

n — m 

Application to determine the most suitable equation is not the real 
purpose of this criterion. Rather it is of value in determining which of 
two representations is the more suitable — ^to answer, for instance, in 
some particular case questions hke those asked at the beginning of this 
section. At best the process is likely to be rather long and tedious. 

An interesting application of the foregoing criterion has been made 
by W'ensel and Tuckerman,^ of the National Bureau of Standards at 
Washington, D. C. A published paper on the thermoelectric power of 
rhodium as a f un ction of temperature for the range 850° C to 1350° C 
seemed to show a discontinuity occurring at about 1100° C. As a con- 
sequence, the original authors in presenting equations to represent their 
data gave two least-squares relations of the form of Eq. 55a, one for the 
range 850° C to 1100° C, the other for the range 1100° C to 1350° C. 
After reviewing the work, Wensel and Tuckerman decided to apply the 
Gauss criterion. They compared the 0-value according to Eq. 96 for 
two least-squares parabolic relations each involving three free param- 
eters and each covering one-half the full range with the 0-value for 
a single parabolic relation covering the whole range. It was resolved 
to the comparison of a fit involving six free parameters with one involv- 

1 Wensel, H. T., and Tuckerman, L. B., Rw. Sd. Imtrummts, 9, 237 (1938). 
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ing onlj^ three. (See Fig. 16 of Chap. II, in which the authors present 
the two points of view graphically.) 

The results obtained by Wensel and Tuckerman are shown in Fig. 2 
and Table V. It is seen that the single parabola covering the whole 
range jdelds the smaller value for the criterion expressed in Eq. 96 and 
therefore possesses the closer fit. Incidentally it was concluded that 



Fig. 2. Showing deviations (yo - y) between observed and least-squares emf’s for 
rhodium against platinum for cases (A), a parabolic relation for the range 850° C < 
T < 1100°C, (R), a parabolic relation for the range 1100°C < T < 1350° C, 
and (C), a parabolic relation for the range 850° O < T < 1350° C. The results 
are summarized in Table V. 

the supposition of a thermoelectric discontinuity is not justified. Inci- 
dentally also, in view of precision index considerations, it would seem 

that the values given in the table for i2, — are not significant 

n — m 

to the extent shown. 

TABLE V 


Showing Certain Details for the Application op the Criterion 
POE Closeness of Fit, as Applied by Wensel and Tuckerman 

[The data contained are those plotted in Fig. 2] 


Case 

n 

No. of 
observations 

m 

No. of free 
parameters 

n — m 

2(?yo “ yf 

in 

2(j/o - v)^ 
n — m 
in ()uv)^ 

Two parabolas 

11 

6 

8 

0.0434: 

0.00542 

One parabola 

M 

3 

11 

0.0527 

0.00479 


16. Stimmary. Of the many products of least squares, among the 
most valued is the method it provides for determining the arbitrary 
constants for a best equation of a specified type to represent observed 
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data. The types here considered are limited (1) to those involving two 
variables only, one independent, the other dependent, and (2) to those 
possessing linearly related arbitrarj?" constants or such structures that 
those constants or functions of them may be linearly related. 

For the case where the specified linear relation is given by 

y = a + hx [4] 

it is common, but not necessary, to assume that the iz-values only are 
subject to variation. The condition that the sum of the squares of the 
deviations of the observed yo^s from the given for the same by 
the least-squares equation shall be a nGunimum, leads, when applied, to 
definite expressions for a and h. For equally weighted values of yo^ n 
in number, they are 


'Zx^'Syo - SrcSzj/o 
“ “ - {lixf 

[9] 

nZxyo - SxSj/o 
"" riSx^ - (Sx)2 

[10] 


For ^/o-values having varying weights w, the equations become instead 

'Ewx^'Zwyo — 'hwxEwxyo P .. 

Xw'Zwx^ — 


a — 


b = 


^whwxyo — 'Lwxhixyo 
HtwZwx^ — 


[ 22 ] 


Many equations may be altered in form to make them effectively 
linear and thus subject to least-squares treatment. 

Disregarding weights one may obtain more than one least-squares 
value for a given constant by using the same basic relation expressed 
differently. For the first radiation constant, for instance, we have for 
the equally weighted forms 

' [37] 


2(r4)2 

S In (S - 4S In T 


= In ^ 


and 


[40] 

[43] 


1 ^ 

It is shown that, when one shifts from one to another of such forms for 
computation purposes, changes of we^ht have been tacitly given to the 
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different items of data and that, when allowances are made for these 
changes, the same results may be expected by the different procedures. 

Probable errors, 'Pa and may be computed for the constants of 
a least-squares straight line which has been obtained for an equally 
weighted set of points treatment in accord with that shown in Chapter 


X, p. 229, yields 



Pa 

/• 

[50] 

and 


Vh 

^nSx^ - (2xf 

[51] 

of which pyQ is given by 



'2(2/0 — a - bx)^ 


PyQ ~ 

0.675 

[52] 


n 


Expressions for and pi, not involving pj/o? obtained from Eqs. 50 to 
52 or derived from independent considerations are 


Pa = 0.675 

and 

Ph = 0.675 
The parabola 


2xyxy + 



y — a + bx + cx^ 


[53] 

[54] 

[55] 


treated in a manner similar to that for the straight line yields the 
cumbersome expressions of Eqs. 58 for the constants a, h, and c. How- 
ever, when certain conditions are fulfilled these expressions are much 
simplified. 

For the special conditions (1) that the given or observed values of y 
are equally weighted, (2) that the successive values of x differ by a 
constant, (3) that the values of x are exact, and (4) that the values of 
X are arranged symmetrically with respect to a central zero value, the 
least-squares equations for the evaluation of the arbitrary constants for 
polynomials, involving 5:-terms up to at least the third degree, are all 
greatly simplified. A change of variable from a: to X to meet condition 
(4) is necessary, and to make the difference specified by condition (2) 
the numeric 1 is convenient. For the case that n the number of pairs 
of values is odd or even, X is defined by 


or by 




X 

Ax/2 


-) 


n even 


[65] 

[ 66 ] 
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With this change each coefficient of the least-squares polynomial be- 
comes expressible as a single term or as the difference between two 
terms, each of which consists of the product of a function of x and a 
summation such as SXyo, or The method of com- 

bining the functions of X due to Baily is shown in Table VI of Appendix 
2. Values for these functions of X, as tabulated by Cox and Matuschak 
for values of n up to 50, will be found in Tables VII and VIII of Ap- 
pendix 2. With the aid of these tables, many otherwise rather formi- 
dable least-squares evaluations become rather simple. A generalized 
expression for the coefficients of a polynomial of any degree as developed 
by Birge and Shea is given by Eq. 74. 

In certain instances the equation connecting observed data cannot 
be transformed directly to yield a linear relation connecting the co- 
efficients to be determined. In this case with y = fix) representing the 
desired relation, and a, 6, and c the desired coefficients (1) an approxi- 
mation = f{x) is assumed and (2) the difference {y -- y') is then 
developed in accord with Taylor's series and treated in the form 

A.y = y-y'= Aa + (|-) Ah + • [78] 

The correction to an assumed ordinary sine relation then becomes 

Xy = sin (wiS 4- V) ^ Aa — a' cos (o)t -|- V) X Ab [79] 

of which a' and b' are assumed approximate values for a and b. 

The constants for a least-squares equation of the type 

y = a + bx [4] 

when both x and y are liable to error are given by a solution of the 
simultaneous equations 

a = -i:Zy- hZx) [94:] 

n 

and o / \ ■> 

. - [(Sy)^ - nSf] (py\ _ ^ 

SxSj/ - riExy \pJ 

A criterion for closeness of fit for cases in which y only is liable to 
error is contained in Gauss’ mean-square deviation. Where yo is the 
observed value, y the corresponding least-squares vaJue, n the number 
of observed pairs of values, and m the number of arbitrary constants or 
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free parameters for the equation, the criterion in equation form becomes 


Q y}- — a minimum 


n — m 


[96] 


Of all equations, that which yields the least value for Q. is assumed to 
best represent the given data. 


PROBLEMS 

1. Millikan (Phys. Rev., 7, 355, 1916, Pigs. 5 and 6), in a determination of Planck’s 
constant, h, by the photoelectric method using sodium, found that for certain wave- 
lengths of radiation, X, certain stopping potentials, V (actually, as measured, stop- 
ping potentials less contact emf between sodium and copper), were required to just 
prevent a photoelectric current in the cell used. From a straight-line plot of V as 
a function of frequency, c /X, he obtained h/e, the theoretical slope of the line. This 
he combined with the electronic charge, e, which he had measured otherwise, to 
obtain h, the quantity desired. The data (these values are taken from the curves 
of Fig. 5, and may not check Millikan’s values precisely) plotted are: 


X 

7 

(A) 

(Volts) 

2535 

0.520 

3126 

-0.385 

3650 

-0.915 

4047 

-1.295 

4339 

-1.485 

5461 

-2.045 


Using Millikan’s data and the least-squares method, determine h/e. Then, using 
Millikan’s 1916 value for e, namely 4.774 X 10“^® escoulombs, see how closely you 
agree with the value h = 6.56 X 10“^^ erg sec which he obtained from this par- 
ticular set. 

2. One of the best methods of determining the ice point on the Kelvin temper- 
ature scale is that of determining for a gas, a, the limiting mean coefficient of press- 
ure increase at constant volume on heating from 0° C to 100° C,- as the pressure 
approaches zero, and computing its reciprocal. Data for such a computation ob- 
tained by Beattie are given in Table II. Using the data there presented as adjusted 
and giving equal weight to each determination of and assuming the relation 
<x^ = OL Fy p, where is a constant, compute a least-squares value for a and 
for To. Also determine its probable error. The suggested treatment is somewhat 
different from that actually used by Beattie. Small corrections applied to values 
to yield values expected for 1000.00 mm-Hg, 750.00 mm-Hg, etc., and change of 
the dependent variable to less a convenient function, will reduce the labor of 
computation very greatly without affecting the result appreciably. 

3, If the broken line, given hy y ad for the range 0 < ^ < 7r/2 and by y ^ 
a{7r-$) for the range x/2 < e < tt, is to be represented as well as possible by the 
single term aisin^, show that the best value for ai is that prescribed for the first 
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term, of the Fourier half-range sine series which represents the line. Given that 
instead it is to be represented by <13 sin 30, show that the best value for <23 is then the 
third term of the same series. 

4. On the basis of least squares, derive the best equation of the type y == 

4 - , 

(dm sin md -}- hm cos m0) to represent 20 given values for points throughout the 

OT= 1 

range 0 < 0 < 27r having equal 0-separations. Assume the 2/- values to be such 
that the 6o/2 term is negligible. (Use if nec^sary the derivable relation 



of which Pf m, and r are integers.) 

6. Using the smoothed data for I /In * f(T) obtained in the working of prob- 
lem 2, p. 27, determine least-squares equations of the forms, ^ ^ a -f 

I T /'TV log(2^/^n) 

h log (T/Tn) and — ci + b— + Also using the “criterion of closeness 

in in \i n/ 

of fit,’’ determine which equation is preferred for representing the data. 

6. Using Halliday’s data as given below (see graph p. 175) showing pulse intervals 
of no a-particle reception from an a-particle source by an a-particle counter, obtain 
a least-squares equation of the type P — where P represents the probability that 
a pulse interval shall be as long as or longer than t 



Interval, sec 

Probability 

Interval, sec Probability 


0.0-0. 5 

0.3540 

3. 5-4.0 

0.0175 


0. 5-1.0 

.2250 

4. 0-4. 5 

.0120 


1.0-1. 5 

.1420 

4. 5-5.0 

.0090 


1. 5-2.0 

.0960 

5. 0-5. 5 

.0040 


2. 0-2. 5 

.0690 

5. 5-6.0 

.0065 


' 2. 5-3.0 

.0350 

6. 0-6. 5 

.0025 


3.0-3. 5 

.0275 



7. The average barometric pressure and temperature for the summer as a function 
of altitude in the region of Paris are reported (Smithsonian Physical Tables 7th Ed.) as 

Altitude 

Pressure 

Temperature 

Altitude 

Pressure Temperature 

Km 

mm-Hg 


Km 

mm-Hg °C 

0 

760.0 

15.7 

12 

151.2 -51.0 

2 

598.0 

7.5 

14 

111.1 -51.0 

4 

466.6 

-3.0 

16 

81.7 -51.0 

6 

360.2 

-15.1 

18 

60.0 -51.0 

8 

274.3 

-29.7 

20 

41.1 -51.0 

10 

205.1 

-45.5 



For a homogeneous atmosphere the expected pressure-altitude relation is given by 



V 



Because of the temperature variation, f 

i much better fit is obtained, using the relation 



II 

+ (1 - A)er^’'\ 



From a graph showing in(l - p/po) == /(^), one may obtain acceptable values for 
A and a. Using the least-squares method, find a most acceptable value for p. 
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8. The 1939 determination of the specific heat of water in terms of the 15° C 
calorie at the Bureau of Standards by Osborne, Stimson and Ginnings ^ yielded the 
foUo'Rung: 


rin °C 

cal 

Tm°C 

cal 

^ gm G® 

^ gm C 

0 

1.00762 

55 

0.99919 

5 

1-00392 

60 1 

0.99967 

10 i 

1.00153 

65 

1.00024 

15 

1.00000 

70 

1.00091 

20 

0.99907 

75 

1.00167 

25 

0.99852 

80 

1.00253 

30 

0.99826 

85 

1.00351 

35 

0.99818 

90 

1.00461 

40 

0.99828 

95 

1.00586 

45 

0.99849 

100 

1.00721 

50 

0^99878 




Determine a least-squares equation to represent the above data of the type 
Cp — a hr cr^ + dr® 

where r represents T — 0° C. If a computing machine is not available, round off 
Cp values to the fourth decimal place or use only values corresponding to 0° C, 10° C, 
20° C, etc. 

9. -f .,,Moh 

Kp is an equilibrium constant. Ail the heat of reaction, R the ideal gas constant, 
and T the absolute temperature, is one of the most important equations of chemical 
thermodynamics. Slopes taken from a curve showing In = f{l/T) permit of a 
determination of heat of reaction as a function of temperature. For the reaction 
N 2 ^ 2Ni, Lewis and von Elbe ^ have tabulated published data which in part are as 
follows: 

T in °K 300 400 600 800 1000 1200 1600 2000 

logKp'mA 118.1 86.9 55.8 40.2 30.9 24.6 16.8 12.0 

Derive (1) a least-squares equation showing In Kp = /(1/T), and (2) an equation 
showing AR = /(T) for the dissociation of nitrogen. 

10. Cragoe of the Bureau of Standards {Am. Inst. Phys. Symposium on Tempera^ 
ture, etc., Reinhold Publishing Corporation, New York, 1941, p. 104) in a dis- 
cussion of the “slopes of PV isotherms’^ of real gases calls attention to their 
“importance in atomic-weight determinations, in gas analysis,” etc. He cited certain 
data on nitrogen at 0° G which were obtained by Michels, Wouters, and de Boer at 
the van der Waals Laboratory in Amsterdam and presented various least-squares 

1 Osborne, N. S., Stimson, H. F., and Ginnings, D. C., J, Mesearch Nat. Bur. Standards^ 23, 197 (1939). 

2 Lewis, B., and von Elbe, G., Combustion, Flames and Explosions of Gases, p. 382, Cambridge, at 
the University Press. 1938. 
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equations to represent them. The data and one of the equations for aU pairs equaUv 

•«rcnrrh+.^rl Tr»llnw* ^ ^ 


v_ 

% 

pv 

Po 

V 

pm 

19.0215 

19.1606 

0.99274 

23.7629 

23.9734 

.99122 

28.4968 

28.7894 

.98983 

33.1101 

33.4951 

.98851 

37.9526 

38.4409 

.98730 

42.7435 

43.3413 

.98621 

47.4376 

48.1401 

.98541 

52.2160 

53.0328 

.98460 


10' ~ = (-45.3236 ± 0.352) h - i) + 0.29885 (- - iV 

Poso \v / \v / 


This equation may be checked rather closely without undue labor by (1) plotting 
Pv/vqX 

^ Pqvq ~ ^ ^ 1 > obtaining, with, the aid of the physical slopes of the 

curve at appropriate points, values of In and then of In — 1 I for neiah- 

Pqvq pm‘\v ) 

boring equally spaced values of as 18.10, 22.95, 27.80, etc., and (3) appljdng 

to such pairs of values the method which makes use of the tables by Cox and Matu- 
schak. What change of weights is involved? Check Cragoe’s equation. 

11 . One method of determining the optical constants of a metal consists in deter- 
mining the reflectivities of the polished metal for light polarized respectively in the 
plane of incidence, jRii, and perpendicular to that plane, 7?i. One of the authors ^ 
has done this for tungsten and obtained the following tabulated values. 


Angle of 
Incidence 

R\\ 


76° 

82.5% 

12.30% 

77 

83.0 

11.60 

78 

84.0 

11.05 

79 

84.5 

11.15 

80 

85.6 

11.60 

81 

86.6 

12.40 

82 

87.9 

14.40 


On the basis of Chauvenetjs criterion two R\\ values have been discarded. The angle 
of principal incidence is the angle for which the ratio jRii/iEi is a maximum. Using 
least-squares procedure and the above data, determine the angle of principal inci- 
dence, also the angle of principal azimuth ^ which is defined by 


tan^^ == 


■Kn 


for the angle of principal incidence. 

^ Wortbing, A. G., J. Optical Soc. Am., 13, 647 (19^). 



CHAPTER XII 


CORRELATION 

1. latroductioii. In the discussions of Chapter XI leading to least- 
squares expressions for y = f{x), we tacitly assumed that, for each given 
value of X, there corresponded a single definite value of y. In the 
language of the section about to be developed, we assumed a correlation 
of unity. We now consider cases where y is, in addition, a function of 
other variables which may not be known. In particular we w ish to 
determine vithin what range of certainty a mathematical relation, de- 
veloped to express the interdependency of two variables, may be ac- 
cepted for yielding definite values for one variable when values for the 
other are given. 

Generally we speak of correlations between factors, or accomplish- 
ments, or attributes, or characteristics whose dependencies on one an- 
other are only partial. Most often, perhaps, we think not so much of 
the physical dependence of these attributes on each other as of their 
dependence on certain other attributes which may only be surmised. 
It thus has meaning to speak of correlations (a) between students’ 
grades in mathematics and in physics (Table I and Fig. 1), (6) between 
the daily temperatures at noon at Pittsburgh and the corresponding 
temperatures for succeeding days at New York, (c) between the heights 
of fathers and the heights of their sons, (d) between the average rainfall 
in a region during some one month as June, say, and the average corre- 
sponding temperature, (e) between the stellar magnitudes of stars and 
their proper motions, etc. 

It is evident from Fig. 1 that physics and pre-math test grades are 
somehow related, since on the average, students with high math grades 
made higher physics grades than the students with low math grades. 
However, the scattering of the points about the least-squares line which 
has been drawn is very great and cannot be ascribed to random errors. 
In cases like this the variables are said to be stochastically related or 
correlated, rather than causally or functionally related as in Chapter 
XI. Stochastic relationships may be nonlinear as well as linear apd may 
exist among three or even more variables. 

In this chapter we treat first the case of two variables assumed 
linearly related. The correlation coeflficient, r, is derived and its signifi- 
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TABLE I 

Grades in Beginning Mathematics and Physics at the University 
OF Pittsburgh Obtained by a Group of 69 Students 


[The mathematics course preceded the physics course] 


■ No. 

Pre-Math 

Grades, 

Z 

Physics 

Grades, 

Y 

No. 

Pre-iMath 

Grades, 

X 

Physics 

Grades, 

r 

1 

58 

112 

36 

78 

164 

2 

59 

141 

37 

79 

134 

3 

63 

113 

38 

97 

215 

4 

58 

161 

39 

83 

204 

5 

50 

134 

40 

96 

243 

6 

81 

188 

41 

91 

184 

7 

55 

120 

42 

83 

129 

8 

78 

143 

43 

82 

167 

9 

76 

200 

44 

77 

200 

10 

80 

232 

45 

96 

158 

11 

91 

157 

46 

66 

200 

12 

74 

143 

47 

86 

247 

13 

47 

113 

48 

69 

115 

14 

90 

202 

49 

80 

173 

15 

85 

174 

50 

95 

222 

16 

71 

147 

51 

97 

181 

17 

71 

134 

52 

82 

188 

18 

78 

143 

53 

64 

126 

19 

73 

137 

54 

72 

72 

20 

54 

150 

55 

69 

134 

21 

82 

197 

56 

52 

101 

22 

57 

163 

57 

73 

156 

23 

78 

183 

58 

87 

174 

24 

55 

126 

59 

59 

194 

25 

72 

201 

60 

52 

127 

26 

94 

206 

61 

71 

169 

27 

87 

177 

62 

93 

199 

28 

86 

203 

63 

70 

129 

29 

62 

129 

64 

88 

151 

30 

82 

209 

65 

76 

159 

31 

84 

251 

66 

85 

160 

32 

92 

225 

67 

82 

202 

33 

72 

104 

68 

82 

169 

34 

67 

154 

69 

72 

139 

35 

77 

148 






Grad- 
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Mathematics Grades 

Fig. 1. Diagram showing a correlation between the mathematics and the physic 
grades obtained by a group of students. See Table 1. 
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THE CORRELATION COEFFICIENT, 

c 3 »ncc, liiiiit8»i/ioiis, End. 'us6s- discuss6d. For tiie cesg of two variables 
nonlinearly related, we define and discuss the correlation index, p. The 
coeflB-cient of multiple correlation is then defined for the case where the 
dependent variable is correlated linearly with two or more independent 
variables. Finally, we define the coeflScient of partial correlation to 
describe the correlation (linear) between tw'o variables when a third is 
held constant. 

2. The Correlation Coefficient, r. When variables X and Y are cor- 
related rather than functionally related, we should no longer speak of 
a ''best” F-value to correspond to each X-value but only of a most 
probable F-value about which observed values may be distributed 
according to some frequency distribution law. Obviously, the closer 
the observed values are to the most probable value, the more definite 
is the relationship between F and X. This postulate is the basis for 
the various numerical measures of the degree of correlation. 

On the least-squares assumption that the observed set of data is the 
most probable set, the most probable F-value for a given X-value is 
that given by the least-squares equation. For the linearly related case 
with one variable only liable to error, the equation was derived in Chap- 
ter XI. With the origin moved to the point represented by the means 
XF, i.e., with change of variables to a; = (X — X) and y = (Y — F), 
the equation reduces, for the condition that the line must pass through 
the new origin (Eq. 35a of Chapter XI), to 



As a measure of the dispersion of the observed ^/-values about the 
least-squares line, a quantity Sy called the standard error of estimate 
is introduced. Defined by 



it is the square root of the mean of squared deviations, not from an 
average but from values predicted by the least-squares line. 

The actual correlation coefficient, r, is defined by 



It is a numeric independent of the units of the variables correlated. 

As heretofore, the a of Eq. 3 denotes a standard deviation from a 
mean. But there is this difference: the mean as used here is merely an 
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average, while heretofore it has been additionally a best value for 
some measured quantity. The quantity, v , is often called the 
coeflScient of determination, and the quantity (Sy/(Ty) , the coefficient 
of alienation. 

3. Limiting Values for r. Using Eq. 3, we can readily evaluate the 
limiting values wliich r may assume. Since (Sy/o-y)^ cannot be negative, 
the maximum value of r is 1, corresponding to Sy = 0; i.e., to 
2(y — = 0. Thus, the maximum value of r occurs when all the 

observed points lie on the least-squares line (Fig. 24). The minimum 
value of T is zero, corresponding to (Sy/(Ty)^ = 1, or Sy = (Ty, For Sy 



(A) (B) iC) 

Fig, 2. Illustrating the distribution of observed points about the least-squares line 
for the extreme cases (A) r == -\~l; (B) r — 0; (C) r = —I. 


to equal o-y, it is necessary that yc = 0 and that the least-squares line 
shall be parallel to the X-axis and intersect the F-axis at F (Fig. 2B). 
From Eq. 1 it is seen that yc = 0 when lltxy = 0, a relation which was 
recognized in the discussion of the propagation of precision indexes in 
Chapter IX. as the condition for complete independence of variables 
X and 2^. Thus, the value r = 0 corresponds to complete lack of correla- 
tion. A negative correlation coefficient indicates . that the assumed 
dependency is opposite to what has been supposed. It is, in effect, a 
positive coefficient for a reversed relation (Fig. 2(7). 

4. Correlation and Frequency Distribution. Though not evident 
from the foregoing, it is possible to show that the correlation coefficient 
r is definitely connected with the normal frequency distribution of 
measurements.^ Similar to the distribution law for measurements of a 
single quantity (Chap. VI), namely 

mdx= [4] 

V ^ V27r era; 

^Whittaker, E. T., and Robinson, G., The. Calculus of Observations^ London,- 
Bkckie Ar Son, Ltd., 1926. 
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it may be shown for the frequency distribution of pairs of measurements 
of separate quantities that 

f{x,y)dxdy 

27rcrxcry'^ 1 “ 

In this latter expression, the r' represents an interdependence factor for 
the X and y variables. If x and y are independent of each other, i.e., 
if r' equals 0, the sign of the xy term will be as often positive as negative 
and will disappeai' from the expression for probability of occurrence in 
the dx dy range. The expression then becomes 


[/fe y) dx dy]r'=Q = 


"TT (Tq- CT y 


[ 6 ] 


the well-recognized expression for the probability of simultaneous occur- 
rence of a randomly chosen pair of x- and y-values when those values 
are unrelated, or, as we often say, of two unrelated phenomena. If, on 
the other hand, the relation between x and y is definite, i.e., if r' equals 
unity, we have 

\J{^,y) dx dy\'=i -= 0 [7] 


This likewise is the expected value for the probability of a simultaneous 
occurrence of an x- and a y-Yslue chosen at random when the relation 
between x and y is definite. The interdependence factor r' may be 
shown to be identical with the correlation coefficient r. 

5. Pearson’s Product Moment Formula. Eq. 3 is general^ not the 
most convenient form for calculating the r for a particular set of data. 
To obtain such a form, we first replace yc of Eq. 2 by its equivalent as 
given in Eq. 1, obtaining 




n 


{ZxyY' (Sxy) 


21 




Sx^ 


nSx^ 


[ 8 ] 


Then, by the elimination of Sy from Eq. 3, we have 



^ / (Hxyf 


^xy 


[9] 


Eq. 9 is known as Pearson^s product moment formula. It is much more 
convenient than Eq. 3 for calculating r. 
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Going farther, we may use the short-method check equations for Cx, 
cy, etc. (Chap. VII, Eq. 13), to express r in terms of the original vari- 
ables X and Y. Then Eq. 9 becomes 


SZF - n XY 

V(SX2 - _ ^ 7 ^) 


nZXY - SXSF 


- (SX)2][riSF2 - (SF)^] 

Despite its formidable look, Eq. 10 is probably the most convenient 
form for calculating t. Especially is this true if a computing machine 
is available. Applying Eq. 10 to the 69 pairs of X- and F-values of 
Table I, we obtain 

SXF = 884,280 [11] 

X = 75.7 [12] 


= 406,727 
SF^ = 1,985,220 


r = 0.62 


Since in Eq. 9 and therefore also fundamentally in Eq. 10 only devi- 
ations from the means of the quantities being correlated enter to deter- 
mine both the numerator and the denominator, the choice of zeros for 
the X and F readings of Eq. 10 is arbitrary. To illustrate, in the corre- 
lating of the heights X of individuals with their weights F, it suffices 
in applsnng Eq. 10 to use only heights in excess of some conven- 
ient value, such as 5 ft 8 in., and weights in excess of some con- 
venient weight value, such as 160 lb. Further, since X and F appear 
raised to the same powers in both the numerator and the denominator 
of Eq. 10, the units in which X and F are expressed are also arbitrary. 
If for any re^on computations are made more convenient thereby, in 
a problem like that just discussed, one might use the in. as the unit 
of height and 2 lb as the unit of weight. Just how advantageous these 
considerations are will appear in connection with the next section. 

6. Correlation Coefficients for Grouped Data. When the number of 
pairs of items to be correlated is large, the calculation of r by the stand- 
ard procedure may he time-consuming. In such cases it is desirable to 
shorten the process by grouping the item pairs as is done in a correlation 
table. Table II illustrates how this may be done for the mathematics- 
physics grades of Table I. Note that for the mathematics grades 6 
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ranges have been selected with midpoints at 60, 60, • v* 100, and that 
for the physics grades 10 ranges have been selected with midpoints at 
80, 100, 120,* * ' 260. In accord with the grouping principle, the pair 
of grades 57 for mathematics and 112 for physics is found in the cell, 
as it is called, which is at the intersection of the 55-65 column and the 
110-130 row. All of the pairs of grades that fall within the limits pre- 
scribed for this cell are to be treated in the computation that follows 
as though the mathematics and ph^’^sics grades w^ere respectively 60 and 
120. Table II shows that there are 6 pairs of grades to be so treated. 
For the ranges chosen in Table II, there is a difficulty arising when, 
for instance, the mathematics grade is just 65. Different procedures 
are then possible. The grade may be recorded with half weight in both 
the 55-65 and the 65-75 columns. Instead, it may be recorded with 
full weight in the 55-65 or low^er coluimi, with the understanding that, 
with the next similar occurrence, the grade will be recorded with full 
weight in the next higher column. Of course other rules may be set up 
in order that the effects of several such cases shall be negligible as to 
the combined results of the particular choices of assignment. 

As for the standard procedure described above, Eq. 10 is basic for 
the computations contained in a correlation table. Note that, taking 
advantage of the feature pointed out above, regarding the arbitrariness 
of the zeros and the units of measurement, the rather large and cumber- 
some numbers used in expressing X and Y in Table II have been replaced 
by the convenient small numbers of X' and Y\ Values for X', F', their 
frequencies /, /X', f Y\ /X'^, and /F'^ are shown in appropriately headed . 
rows and columns. Values for /X'F', howwer, are to be found only in 
the lower right-hand comers of the cells. 

As might be expected, the grouped-data method with its approxima- 
tions yields for the data of Table I a result for r, namely 0.61, which is 
different from that obtained when the more precise method outlined 
above is used, namely 0.62. The difference, however, is quite insignifi- 
cant, as will appear in the later discussion of the physical significance 
of the r that was found. 

7. Physical Interpretation of a Correlation Coefficient. In general 
the value of the correlation coefficient provides the answer to the ques- 
tion: To what extent is F dependent on X, judging from the particular 
tested sample from the infinite parent group of data? Two other ques- 
tions are usually of equal importance: (1) How is the value obtained 
for r to be interpreted? (2) To what extent does the r obtained for 
the sample apply to the parent group? Thus, for the sample of data 
contained in Table I, the value 0.62 was obtainedffor r. The question 
of the reliability of this value must .await the discussion of the following 
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section. It is now desirable to consider the interpretation of 0.62 as a 
dependency indicator. There are two procedures. 

The first interpretation procedure involves giving attention to the 
corresponding Sy/dy^ the quantity whose square has been referred to 
above as the coefl&cient of alienation. As indicated above, it is the 
ratio (Fig. 1) of the standard ^/-deviation of the plotted points from the 



r 


Fig. 3. Showing Sy/dy — fir) in accord with Eq. 17. 


line representing the least-squares equation with y only liable to error, 
to the standard deviation of the same points from the 2/-mean. The 
higher the correlation, i.e., the greater the dependency of y on x, the 
smaller is Sy/<xy. Rearrangement of Eq, 3 yields 

[17] 



whose locus on a plot, showing Sy/cy — f(r)y is a circle (Fig. 3). 

The value of Sy/dy, corresponding to 0.62 for the value of r for the 
data of Table I, is 0.78. The value of (Tj, for the same data, given by 



[ 18 ] 
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is 38.0. ^ 2 / is 29.6. Correspondingly, Vy{= and Py (= 0.675 

are 25.6 and 20.0. 

Referring to Fig. 1, note that lines A and B are drawn parallel to 
the X- and F-axes and indicate respectively the mean mathematics and 
the mean physics grades as shown by Eqs. 12 and 13. Lines C and D 
corresponding to 

Y =Y^Py= 165.3 ± 25.6 [19] 

enclose between themselves one half of the plotted points. Line E is 
the locus of the least-squares equation computed according to Eq. 1. 
Its equation is 

Y ^Yo^ 165.3 + 1.843(X ~ 75.7) [20] 

Lines F and 0 correspond to 

F = Fe ± P^/ = 165.3 ± 20.0 + 1.843(X - 75.7) [21] 

Like lines C and Z), lines F and G include between themselves one-half 
of the plotted points. The vertical separation of the latter two lines 
is less, however, than that of the first two, the ratio being that of Sy/<Ty 
or, what is the same, of Py/py. 

We may now interpret the significance of an r of 0.62 or of an Sy/dy 
of 0.78 as applied to the data of Table I. Given that a student has a 
grade of 90 in mathematics, what can we say of his probable performance 
in physics? Ignoring the correlation between mathematics and physics, 
our best estimate of his grade is 165.3 and the chance is 50% that the 
grade will lie between 139.7 and 190.9, i.e., in the range 165.3 i 25.6. 
However, knowledge of the correlation between mathematics and physics 
grades, found from Table I, enables us to make a prediction in which 
we have considerably more confidence. From Fig. 1 we see that about 
196 is the most probable physics grade for the student whose math grade 
is 90, and further, the chance is 50% that his grade will lie between 176 
and 216, i.e., in the range 196 zt 20.0. The range for the predicted 
even chance, namely 2P computed on the correlation basis is only 
0.78 of the corresponding range, namely 2py, that results in case corre- 
lation is ignored. 

In view of the foregoing one wonders why the ratio Sy/dy was not 
chosen in place of t to represent correlation. One evident answer is 
that with increased correlation there is a decreased value for Sy/dy. 

In connection with the foregoing interpretation, no indication has 
been given of the reliability of the computed r, Byjdy, py, and Py. These 
features will be discussed in the next section. 

A second interpretation of r treats it as a measure of common causes. 
If X is a linear function of i + Z independent variables which contribute 
equally to its values and F is a similar linear function of j k inde- 
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pendent variables^ where h is the number of variables common to both 
X and r, it may be shown that 


+ m + k) 

On this basis, it would seem that a cor:colation of 62% for mathematics- 
physics grades would indicate that about 62% of the characteristics or 
activities required for the two subjects are common characteristics. 
While this interpretation can doubtless be tested quantitatively in some 
instances, just how it can be so tested in the case just mentioned is not 
apparent. Incidentally one would find it very difiicult to so interpret 
a correlation coefficient of 0.95 relating the annual number of marriages 
in the Church of England and the standard mortality rate for the years 
1866 to 1911. 

It should be remembered that r is calculated on the assumptions that 
the values of Y and X are distributed normally and that, on the average, 
Y is directly (or inversely) proportional to Z. Any significance which 
r may have decreases as the distribution of 7 or X departs from nor- 
mality, and as the average relationship between F and X becomes non- 
linear. With marked departures from normality or linearity, r loses aU 
significance, and other measures of the degree of correlation should be 
used. 

8. The Reliability of Computed Correlation Coefficients. Question 2, 
asked at the beginning of the preceding section, is of interest here. 
If r were a variable whose variations for a number of samples from the 
same parent universe were to follow the normal distribution law^, the 
answer to the question would be simple. It would then be sufficient 
to calculate the precision indexes of r and interpret them in accord with 
the discussion of Chapters VI and VII. 

For small and moderate values of r the equation 


1 — 1 — 7 ^ 



[23] 


where n is the number of Z, F pairs in the sample, seems to hold rather 
well. It fails, however, for small values of n and for values of r near 
the limits of its range of distribution, i.e., near 1 or —1. In these 
regions the distribution of r is particularly skewed (Fig. 4). 

To simplify computation for such skew distributions, Fisher ^ intro- 
duced the function 

2=lln^= [24] 

^ 1 — r 1 — r 

1 Fisher, R. A., Statistical Methods for Research Formers, Chap. VI, 7th Ed. 
Oliver & Boyd, Edmburgh, 1938- 
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Its distribution is nearly normal regardless of the true value of r (see 
Table Appendix 2) and is subject to certain normal distribution 
procedures. 

The standard deviation of 2 ?, and its probable error, are found 
to be 


and 


1 

n — 3 


[25] 


Pz 


= 0.675 / 

Vn-3 


[26] 


where n is the number of pairs of values used in obtaining r or z. Using 
Eqs. 24 to 26, it is easy to calculate whether z, and hence also r, is 



Tig. 4. Expected distribution for computed values of r, obtained from samples of 
10 pairs of X,F values chosen at random from an infinite parent universe whose 
T is 0.80. ■ ® 


sigmficantly different from zero. Further, by the rule of propagation of 
precision indexes for related quantities, the standard deviation and the 
probable error of the difference of two values of z are 

= V <Tz^ + — 2rcr^^(y^. [27] 

and 

= V [28] 

It is accordingly relatively simple to calculate whether or not two values 
of z, and hence of r, are significantly different from each other. For 
translation to r, Table V of Appendix 2 is again helpful. 
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Illustrating the foregoing, consider the 69-pair sample of Table I, for 
which a correlation coefficient of 0.62 was obtained. Using Eqs. 24 to 
26, we obtain in succession 

2 = 0.725 [29] 

<yz = 0.123 [30] 

Pz = 0.083 [31] 

With the aid of the table showing r = f(z) referred to or by means of 
Eq. 24 directly, one finds that the limiting vafues of r coiTesponding to 
various assumed deviations in z involving cz and pz are those shown 
in Table II. Inspection shows that the limits of uncertainty of r with 

TABLE II 


Limiting Values of the Coreelation Coefficient r, Computed as 0.62, and of 
Sy/cTy FOR THE Data of Table I to Correspond to Assumed Dentations of 
(Tz, 2<rz, 2.580-2, AND pz (EqS. 25 AND 26) IN Z (COMPUTED AS 0.725, USING Eq. 24) 


Deviation in z 

Limits for z 

Limits for r 

Limits for Sy/a-y 

Upper 

Lower 

Upper 

Lower 

Upper 

Lower 

<r^ 0.123 

0.85 

0.60 

0.69 

0.54 

0.72 

0.84 

2,rz 0.246 

0.97 

0.48 

0.75 

0.45 

0.66 

0.90 

2.5&rz 0.316 

1.04 

0.41 

0.78 

0.39 

0.62 ^ 

0.92 

Pz 0.083 

0.81 

0.64 

0.67 

0.56 

0.74 

0.82 


change in assumed uncertainty in z vary more for the lower limit of r 
than for the higher limit in the case of a positive value for r. From the 
standpoint of probable errors, it is found equally probable that, for 
other samples similar to that of Table I, the new succeeding values of 
r will lie as frequently without as within the range 0.56 < r < 0.67. 
For Sy/(Ty the range is 0.74 < Sy/(Ty <0.82. From the standpoint of 
the many who attach importance to the 2.580*2 or 99% probability, it 
is very unlikely that any random sample from the parent umverse of 
Table I will yield an r outside the range 0.39 < r < 0.78 or an Sy/a-y 
outside the range ().62 < Sy/o-y < 0.92. 

Still referring to the math-physics grades of Table I, we may next 
answer question 2 above, namely, ^^To what extent does the r obtained 
for the sample apply to the parent group?”, by the following statements. 
If there were no correlation between math and physics grades, i.e., 
T = 0 for the parent group, the probability of obtaining the value 0.62 
or higher for r, or what is the same, 0.725 or higher for z (Eq. 29), in 
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a sample of 69 paii-s of grades would be less than 0.0001. This is the 
probability of a de\dation from the assumed zero value for z, whose value 
in terms of the observed iTz is at least 0.725/0.123, i.e., 5.Q(7g. Hence, 
we may conclude that there is a decided correlation between the two 
grades. Further, on the basis of the 99% probability test for significance 
we may conclude that the value of r for the parent group from which 
the data of Table I are a sample lies between 0.39 and 0.78. 

9. Regression Lines. The least-squares line, Eq. 1, expressing the 
average relationship between Y and X, or between y and x, on the 
assumption that Y ov y only is liable to error, is called the regression 
line of y on x. This name originated with Galton, who first applied 
the theory of correlation to biological data. Considering how a popu- 
lation could remain in dynamic equilibrium if the offspring inherited 
the characteristics of the parents, Galton found, in a study of the 
heights of fathers and sons, that the sons deviated from the mean height 
less than the fathers; i.e., the sons regressed towards the mean. Thus, 
he called the line relating the heights of sons and fathers the line of 
regression. 

Generally, two regression lines can be calculated for the case of two 
correlated variables; (1) the regression line of y on x — the least-squares 
line obtained on the assumption that a:-values are exact, and (2) the 
regression line of x on y— the least-squares line obtained on the assump- 
tion that {/-values are exact (Fig. 5). The equation of the regression 
line of {/ on a; as given above is 



By analogy, the least-squares line obtained on the assumption that 
{/-values are exact is 



or, when expressed, in the more common form 

' S {/^1 

y'c = ^ = Vx [33] 

From Eq. 9, it follows that 



Thus, the correlation coefficient between y and x is the square root of 
the ratio of the slopes of the two regression lines. 
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It is seen that r has the same value regardless of whether a; or ?/ is 
taken as the independent variable. None of the other coefficients to 
be discussed possesses this desirable property. Referring to Gabon’s 



Mathematics Grades 


Fig. 5. A graphical method for computing correlation coefficients applied to the 
data of Table I and Fig. 1. The X-intervals are 10 units in length, with centers at 
mathematics grades 45, 55, 65, etc. The F-intervals are 20 units long with centers 
at 70, 90, 110, etc. The lines of regression .^o£7 on Jf, and B, of Z on F, were 
drawn with due regard to the central point (X, Y) and to the weights attached to 
each plotted point. 
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conclusion that the heights of sons regressed toward the mean, one 
must conclude that, if the best relation between the heights of fathers 
and sons is linear, the heights of fathers likewise regress toward the mean. 

10. A Graphical Method for Computing Correlation Coeffiden^ts. 
Eq. 34 is the basis'for an approximate graphical method for evaluating 
r. This method consists in (1) plotting the data (Fig. 5) ; (2) dividing 
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the X- and 7-axes into a convenient number of equal class intervals; 
(3) replacing the points in each X-interval by a weighted mean point 
(the G’s of Fig. 5) and fitting the best straight line — the regression line 
of y on a;— to these points; (4) replacing the points in each 7-interval 
by a weighted mean point (the X ’s of Fig. 5) and fitting the best straight 
line— the regression fine of x on y—to these points; (5) computing the 
slopes of the two lines and substituting into Eq. 34 to obtain the de- 
sired r. 

For many purposes the results obtained by this more rapid approxi- 
mate method are sufficiently accurate. The data of Table I, when 
treated graphically as in Fig. 5, yielded 0.62 for r. This exact check 
with the value (Eq. 16) computed by the direct application of Eq. 10 
is fortuitous. Computed values ranging from 0.59 to 0.65 would have 
been considered equally satisfactory as checks. 

11. Nonlinear Correlation. When the relationship between two cor- 
related variables is decidedly nonlinear (Fig. 6), the correlation coeffi- 



Weight of Tin Coating in Pounds per Base Box 


Fig. 6. An example of nonlinear correlation — ^hydrogen evolution test values plotted 
as a function of tin coating weights for hot dipped tin plate. Note that if the 
hydrogen evolution test value is taken as independent, the resxdtant regression 
curve would have a greater curvature than has the plotted curve. {Courtesy of 
Mn G. C. Jenison.) 
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cicnt T I0S6S its significance and indicates a lower degree of correlation 
tfian actually exists. In. siicli cases tiie index of correlation^ is con- 
sidered by some to be more reliable. It is defined by th,e ecj^uation 



The quantities represented by Sy and cry are analogous to those of Eq. 3 
defining r; the only difference is that now is the mean of the squares 
of deviations of observed points from a least-squares curve (the regres- 
sion curve) rather than from a least-squares line. The index of corre- 
lation differs from the correlation coefficient in two important respects. 
The first difference lies in the fact that for a given set of x and y values 
there is only a single value for r, but many values for p, a different value 
for each type of equation that may be used to represent the relation 
between 2/ and x. Thus/ a value of p has little or no meaning unless 
the form of the least-squares equation fitted to the data is also reported. 
The second difference between p and r arises from the fact that the value 
of r for a set of x- and ^/-values does not depend on which variable is 
assumed dependent and which independent, while the reverse is true 
for p. Consequently, it is customary to add a subscript to p, e.g., pj^, 
to indicate which variable is assumed dependent or subject to error. 

Considering the uncertainties connected with the interpretation of 
any measure of correlation, it is doubtful that much is gained by calcu- 
lating p instead of r unless the curvature of the regression curve is very 
marked. 

12. Multiple Correlation. We may sometimes consider a variable Xi 
to be dependent on two or more independent variables, X2, Zs* * •, and 
desire to know the correlation between Zi and Z2, Zs*-- For this 
purpose, a coefficient of multiple correlation may be calculated. It is 
usually sufficient to consider Zi a linear function of Z2, Z3 * • • Then 
the coefficient-of multiple correlation between Zi, and Z2, Z3 - * • , usually 
designated by the symbol is the same as the simple coefficient 

of correlation between observed values of Zi and corresponding values 
obtained from the least-squares equation 

Zi^ = a + 6Z2 4 :cZ3+**- [36] 

for which the independent variables are Z2, Z3, etc. It is seen from 
Fig. 7 that for two independent variables, the coefficient of multiple 
correlation is analogous to r and to p except that the value of is 
now determined by the deviations of observed points from a least-squares 
plane rather than from a least-square line or curve. 
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Xy 

Fig. 7 . Illustrating multiple correlation for the case where Xi is viewed as dependent 
on and X3. The short straight lines attached to the plotted observed points 
represent, on the assumption that X\ only is liable to error, deviations of the ob- 
served Xi from the plane of regression of Xi on X2X3. 

13. Partial Correlation. The simple correlation coefficient between 
variables Xi and X2 indicates from one point of view, expressed above, 
the percentage of factors common in the determination of Xi and Z2. 
If one such factor is the value of a third variable, X3, it is sometimes 
desirable to determine the coefficient of partial correlation between Xi 
and X2; i.e., the coefficient of correlation between the values of Xi and 
X2 after the effects of X3 on each has been deducted. Given a set of ’ 
corresponding values of Xi, X2, and X3, the coefficient of partial corre- 
lation between Xi and X2 with the effect of X3 removed — symbolized 
by ri2.3 — ^is obtained by calculating first the least-squares line relating 
XiandXs 


Xic =5 ai + &13X3 

then the least-squares line relating X2 and X3 

[37] 

X2C = «2 + 623X^3 

[38] 


and finally the simple correlation coefficient between the differences 

(Xi - Xic) and (X2 - Xsc). 

The effect of any number of other variables— X3, X4, X5, etc. — may 
be simultaneously removed from the values of Xi and X2 in a similar 
manner and the partial correlation coefficient ri2.345... obtained. 
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Calculations are usually simplified by use of the detenninant R de- 
fined by 

' 1 ^12 ri3 • . . ru 

^21 1 ^23 r2k 

R [39] 

rk2 nz 1 

where ri 2 (== ^ 21 ) is the simple correlation coefficient between Xi and 
X 2 , etc. It may be shown that 

^ 12 . 34 ...& ” ' /= [ 40 ] 

where R 12 represents the cofactor or the minor of ri 2 in the determinant 
jR, etc. 

14. Summary. Where y is a function of x and of other unknown 
variables, it is sometimes desirable to express the dependency of y on 
X to the extent possible. For this purpose the correlation coefficient, 
r, has been developed for cases where the relation is assumed linear and 
the index of correlation, p, for cases where the relation is nonlinear. 
The correlation coefficient is defined by 



where a-y is the standard deviation for the given distribution of values 
for the dependent variable and Sy, called the standard error of estimate, 
is a similar standard deviation for deviations from the least-squares line 
with the dependent variable y only liable to error, which best represents 
the plotted data. With the origin of coordinates shifted to the means 
of the X's and the F's, the least-squares equation for the best line is 



and the expression for Sy is given by 

. [ 2 ] 

The limiting values for t are 0 and ±1. A negative correlation coeffi- 
cient is in ejEfect a positive coefficient for a supposed reversed relation. 
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Correlation coefficients may be shown to be connected with frequency 
distributions. 

The most convenient formulas for computing r are 

T = 

ncTxCJy 

and 

nZXY - SXDF 

of which X and y differ from X and Y only in that the values for x and y 
are measured from the means of X and Y as origin while X and Y are 
measured from the physical origin associated with their actual measure- 
ments. 

There are two w^ays of interpreting a correlation coefficient. Xhe 
first consists in determining first the ratio Sy/dy and then noting that, 
by means of it, predicted values for Y to correspond to given values of 
X obtained with correlation procedure will deviate on the average from 
actual occurring values less than when correlation factors are ignored, 
The fractional amount less is precisely the ratio Sy/a-y. The second 
method of interpreting r i^elates it to a function of the common factors, 
k, and noncommon factors, i and j, determining the magnitudes of the 
two variables being correlated. Thus 

“ Va + k)(j + k) 

Because the distribution of r-values is skewed, even when the distri- 
butions of the variables correlated are normal, procedures for deter- 
mining precision indexes of an individual correlation coefficient are dif- 
ferent from the normal procedure. 

In the text the foregoing has been applied in some detail to the corre- 
lation of physics and mathematics grades obtained by a group of 69 
students. 

Two regression lines are distinguished. One is that of y on x. It is 
the least-squares line 

The other is that of x on y. It is the least-squares line 


[9] 

[ 10 ] 
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Combined with Eq. 9, these equations lead to 



Bq. 34 shows that, when lineai* correlation between two variables is 
sought, it is immaterial which variable is assumed to be the independent 
variable. Further, Eq. 34 serves as the basis for an abbreidated graph- 
ical method of determining correlation coeflSlcients which is described 
fully in the text. 

An index of correlation p defined by 

P = [35] 

has been developed for nonlinear cases. Here 8/ refers to deviations 
from a least-squares curve rather than from a straight line. In specify- 
ing values for Pj the type of least-squares equation assumed and the 
variable assumed dependent must be stated. 

Multiple correlation coefl&cients have been developed for cases where 
the dependent variable is viewed as a function of several independent 
variables. 

Partial correlation coefficients have been developed for two variables 
for cases where the effects of other related variables have been eliminated. 


PROBLEMS 

1 . The proper motion of a star is its apparent angular velocity about the sun as 
seen against the background of the celestial sphere. It is ordinarily expressed in 
seconds of arc per year- The parallax of a star is one-half the angle which the earth’s 
orbit subtends at the star. It is ordinarily measured in seconds of arc. The greater 
a star’s distance the less is its parallax. A certain correlation is to be expected 
between these two commonly measured quantities. For certain reasons it is much 
more convenient to find such a correlation for the logarithms of the proper motions 
and the parallaxes rather than for the quantiti^ directly. Using the values for proper 
motion and parallax given by Russell, Dugan, and Stewart {Astronomy j Vol. 2, p. 637, 
Ginn & Company, 1927) for the 22 brightest stars, determine the correlation co- 
efficient connecting the logarithms of those quantities. State in words the physical 
interpretation you are able to give to your computed value. 




Proper Motion 

Parallax 


Star 

(seconds/year) 

(seconds) 

a, 

Canis Majoris (Sirius) 

1.315 

0.371 

<x 

Carinae 

0.022 

.005 

Oi 

Centauri 

3.682 

.758 

a 

Lyrae (Vega) 

0.348 

.124 

a 

Aurigae (Gapella) 

0.439 

.069 
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Proper Motion 

Parallax 


Star 

(seconds/year) 

(seconds) 

a 

Bootis (Arcturus) 

2.287 

0.080 

/3 

Orionis (Rigel) 

0.005 

.006 

a 

Canis Minoris (Procyon) 

1.242 

.312 

a 

Eridani (Achenar) 

0.093 

.049 


Centauri 

0.039 

.011 

a 

Aquilae (Altair) 

0.659 

.204 

a 

Orionis (Betelgeuse) 

0.032 

.017 

CL 

Crucis 

0.048 

.014 

CL 

Tauri (Aldebaran) 

0.205 

.057 

iS 

Geminorum (Pollux) 

0.623 

.101 

a 

Virginis (Spica) 

0.051 

.014 

CL 

Scorpii (Antares) 

0.032 

.009 

CL 

Pisces Australis (Fomalhaut) 0.367 

.137 

a 

Cygni (Deneb) 

0.004 

.005 

CL 

Leonis (Eegulus) 

0.244 

.058 


Crucis 

0.054 

.016 

CL 

Geminorum (Castor) 

0.201 

.076 


2. In a particular application, it was decided that a saving in time and cost would 
result if the chemical analysis for copper in steel with a copper content ranging from 
0.02% to 0.20%, could be replaced by a spectrographic method. As a criterion of 
application, it was arbitrarily decided that the spectrographic and the chemical 
analyses should agree to within 0.01% of copper, 99% of the time. In a test using 
62 samples, the following values in % for copper content were obtained. 


Chemical 

Spectrographic 

Chemical 

Spectrographic 

Chemical 

Spectrographic 

0.092 . 

0.104 

0.086 

0.097 

0.120 

0.113 

.128 

.127 

.067 

.087 

.088 

.096 

.080 

.083 

.068 

.068 

.088 

.082 

.086 

.087 

.066 

.054 

.126 

.114 

.080 

.078 

,103 

.106 

.076 

.074 

.118 

.107 

.054 

.062 

.044 

.046 

.086 

.102, 

.082 

.072 

.060 

.064 

.105 

.108 

.096 

.101 

.110 

.110 

.096 

.110 

.128 

.140 

.100 

j .095 

.084 

.100 

.163 

.172 

.103 

' .096 

.102 

.090 

.084 

.073 

.110 

.122 

.100 

.101 

.192 

.188 

.076 

.073 

.122 

.129 

.150 

.151 

.206 

.220 

.126 

.135 

.148 

.148 

.152 

.164 

.102 

,099 

.089 

.093 

.142 

.130 

.108 

.104 

.144 

.136 

.090 

.096 

.106 

.107 

,114 

.115 

.106 

.103 

.108 

.103 
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Determine the correlation coefficient, its probable error, and, on the basis of a normal 
distribution of measurements and of differences, the correlation coefficient that is 
demanded in order that the arbitrary criterion should have been satisfied. 

3. Given the data below showing metabolism rates, if, taken in a more or less 
haphazard order, for guinea pigs as a function of the temperature of the surrounding 
atmosphere, T, as reported by Herrington ^ of the John B. Pierce Laboratory of 
Hygiene at New Haven, Conn., determine the correlation coefficient, using Pearson’s 
product-moment formula. 


T 

if in 
kcal 

T 

if in 
kcal 

T 

if in 
kcal 

in C 

day 

in u 

day 

m O 

day 

35.3 

716 

27.9 

720 

21.1 

894 

34.7 

557 

27.8 

678 

21.0 

815 

34.7 

600 

27.8 

677 

20.9 

898 

34.6 

885 

27.8 

739 

20.7 

812 

34.6 

719 

27.7 

777 

20.3 

839 

34.3 

694 

27.6 

700 

20.2 

988 

33.6 

620 

27.2 

693 

20.0 

913 

32.8 

701 

26.8 

753 

19.7 

968 

32.5 

673 

26.7 

713 

18.1 

991 

32.2 

579 

26.3 

766 

17.6 

1005 

32.0 

687 

26.1 

725 

17.5 

935 

‘31.9 

676 

25.7 

893 

16.7 

917 

31.4 

638 

25.4 

752 

16.7 

999 

31.2 

644 

25.3 

801 

16.4 

971 

31.2 

594 

24.8 

784 

16.4 

959 

30.9 

607 

24.2 

789 

16.4 

983 

30.9 

621 

23.7 

787 

16.4 

993 

30.7 

586 

23.2 

794 

16.3 

1023 

30.3 

561 

23.1 

891 

15.8 

1071 

30.3 

592 

23.1 

797 

15.4 

1065 

29.8 

601 

23.1 

835 

15.1 

1050 

29.6 

703 

23.0 

855 

14.0 

1057 

29.4 

583 

22.7 

799 

13.6 

1057 

29.4 

672 

22.7 

905 

13.5 

1104 

29.3 

628 

22.6 

804 

13.5 

1157 

.29.1 

601 

22.6 

833 

13.3 

1085 

28.8 

670 

22.5 

810 

13.3 

1047 

28.8 

605 

22.4 

742 

13.1 

1071 

28.5 

756 

22.2 

852 



28.2 

631 

21.6 

877 


1 


4. Determine the equations of the lines of regression and the correlation coeffi- 
cients for the data of problem 3, using the graphical method. 


1 Herrington, L. P., Am. J. Physiology, 129, 123 (1940). 



CHAPTER XIII 


THE ANALYSIS OF NON-HARMONIC PERIODIC FUNCTIONS 

1. Introduction. A periodic function, as used here, is one which is 
composed in part or in its entirety of a quantity whose magnitude varies 
in a regular recurring manner. In some cases the periodic variation is 
sinusoidal, as for the emf of a dynamo. In other cases the variation is 
in accord vith some other law, as that for the magnitude of an eclipsing 
binary. Some functions contain but one periodicity and are simple. 
An illustration is the displacement of a particle in simple harmonic 
motion from its position of equilibrium. No further comment regarding 
such functions is needed here. Other functions contain more than one 
periodicity and are complex. Those belonging to this latter group are 
further subdivided into two types, the harmonic and the non-harmonic. 

An illustration of the complex harmonic periodic function is that de- 
scribing the motion of a particle of a bowed viohn string. Such func- 
tions may be represented by Fourier series and are subject to Fourier 
analysis (Chap. V). The frequencies involved are a fimdamental and 
harmonics with frequencies which are whole-number multiples of that 
fundamental. Illustrations of the non-harmonic periodic function (the 
descriptive term “complex” is not needed here because there are no 
simple non-harmonic periodic functions) are (1) the height of a tide at 
a given place as a function of time, (2) the forced vibrations of a struc- 
tural member, (3) the frequency of occurrence of sunspots, (4) the solar 
constant, and (5) the magnitude of a doubly or trebly eclipsing multi- 
component star. The analysis of functions of this type forms the sub- 
ject matter of this chapter. Actually the theory applies as well to 
complex harmonic periodic functions. In fact, where the harmonics 
are of rather high orders, i.e., have frequencies many times those of the 
fundamental and where the range given in the data for the independent 
variable is less than that needed for the complete representation of an 
assumed fundamental, the Fourier series method may fail, leaving meth- 
ods like that advanced here as perhaps the only one possible for an 
analysis. 

Normally there are two parts to the analysis of a non-harmonic 
periodic function, (1) the search for the periodicities and (2) the deter- 
mmation of their magnitudes. In some cases, e.g., the tides, the perio- 
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dicitiGS, loS/St most of tliGm, a,rG known witb. some precision in ncivo/nce 
bec8<us6 of th.e known causes. The same is true sometimes with regard 
to structural vibrations. For these cases, the first step of the normal 
procedure is greatly shortened. For the other cases, for which the 
normal procedure is generally rather long drawn out, inspection proc- 
esses will often help in reducing the time required. 

Since the procedure for a case involving three or more unknown 
periodicities is the same as for the case involving only two and differs 
from it essentially only in being longer, a case involving only twn com- 
ponent periodicities has been selected for discussion. Moreover, since 
nothing in generality is lost and something in completeness is gained by 
using a function composed of sinusoidal components, the function has 
been thus further restricted. In what follows, we first discuss the under- 
lying theory, make a search for the periodicities, and then finally deter- 
mine their amplitudes. 

2. General Theory. Let 

2 = f(t) = a + a' sm(^,t + + a" sia t + + ■ 

= a + z' + z'' +■ [1] 

describe a function for which values, zij Z 2 , • are given corresponding 

to various successive instants of time, ii, t 2 , ' separated from one 

another by the constant interval, r. If the function chosen is not 
sinusoidal, the treatment that follows would still apply unchanged up 
to a certain point. That point is reached when attention is transferred 
from periods, for example, to amplitudes and phase lags. 

Let the fluctuations in z and the data be such that it is apparent by 
inspection that one of the periods T" is between m'r and (m' + 1 )t 
where m' is a whole number. With e' representmg a positive unknown 
fraction less than unity, we may write 

T' = (m'' + €^)t [2] 

Also let 

r" = (m" -f ' e")r [3] 

of which m'' and similar to w/ and e *m meaning, but both unknown, 
represent the condition so far as the second periodicity is concerned. 
For the present, let m' and m'' be incommensurable. If the fluctuations 
are such that a value for m' or m'' is not apparent, the general plan of 
procedure will remain unchanged. The main difference, as will appear 
later, is in the amount of labor involved. 

With the data tabulated and an approximate value for m', as defined 
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by Eq. 2 or Eq. 3, obtained by inspection or otherwise, the next step 
in the search for the periodicities consists in arranging the given values 
of z and certain of their means in the following array 



^2 

23 

* • 



4-3 

* * ^2m' 




' * 

^km' 4-1 

^km'+2 

^km' -}-3 



Z '2 

CO 

Z'r.’ 


Let Z\^ Z '25 • represent the means for the successive columns. 

Next one determines cr^, the standard deviation for the entire group of 
z values of the array; az'^ that for the means Z\ • • and the ratio 
cr^z/o-^. The value of (Xz does not depend on the details of arrangement 
in an array. 

If Qi + the nunaber of periods of magnitude T" involved is 

very large, the condition that T' and T" differ appreciably and are 
incommensurable will insure that the contributions of the 2 ;"-term of 
Eq. 1 to the various Z'^s will be approximately equal. All of the varia- 
tions in the means will then be due to the s'-term, and the cr^/ that has 
been computed wiU be a function solely of that term of Eq. 1 and the 
array A. 

Consider now the effect on a az, due to a variation of e. For the 
discussion that immediately follows, assume that we have at hand the 
values of the function of z of Eq. 1 at all instants desired rather than 
at instants differing only by r. We may therefore consider arrays like 
that of A above with varying r^s and consequently varying e^s. Consider 
the case of € = 0. It is now evident that, if for one 2 : in a particular 
column the T-periodicity has given its maximum contribution, every 
other z in the same column will have received necessarily the same maxi- 
mum contribution. The evident result is that the crz for that con- 
dition will be a maximum. For any slight shift of r yielding an e other 
than zero, the crz then computed will be smaller. Only when a crz is 
known to be a maximum can we be sure that the corresponding mr 
represents a true period for the function. 

Generally data are not available for testing with the gradually varying 
T assumed possible just above. We must seek the condition for a maxi- 
mum crz from values for various instants corresponding to a fixed r. 
In practice this condition of varying r is approximated by an artifice. 
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Occasional appropriate values for z are omitted from the original set, 
their places in the array are filled by the items of the original set next 
in order, and the series of values thus obtained are treated in the regular 
manner but with the understanding that now the period is equal to 

+ €)t. How this can be done mil be illustrated later. It is sufficient 
to say here that one may thereby effectively determine various azs 
corresponding to various e^s, to find the e which yields the desired maxi- 
mum for az- Strictly, the maximum orj^/o-g, sometimes called the corre- 
lation ratio, is desired, for o-^ will vary slightly with the omissions. In 
practice, a maximum for az often suffices. 

For sinusoidal periodicities only, the values of and 

other similar ratios that may have been obtained for other periodicities 
present may ordinarily be used to deteimine the relative amphtudes of 
these various components and to determine at any stage in the pro- 
cedure whether any remaining periodicity has been left undiscovered. 
To show this, one needs to consider in detail how the various <r^s and the 
amplitudes are related . 

For the assumed case of incommensurable periods and a sufficiently 
great number of measurements, we have largely as a result of definitions 
the following relations for the case of an array of n terms: 




2 


and 

,2 ^ 12(3 - a)2 =-S(z' +/'+■■•)' 

n n 

= - S(3'^ 4- 2z'z" + 2"^ H ) [6] 

n 

In the above expression, the summation for the tem 2z'z'' _:^eld 
zero, since for the signs of the terms being summed the result ^ be 
as often negative as positive. Eq. 6, with the aid of Eqs. 4 and 5, may 
therefore be reduced to 

* a'^^ 

= - S(3'2 + z"^ +• ■ •) = +■ ■ ■ “ V*" "i" 

n 
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From Eqs. 4, 5, and 7, we obtain finally 


crz' 



Eq. 8 shows that the amplitudes of the various components of z vary 
as their <tz/o-z^- Eq. 9 shows that the sum of the squares of the various 
must add up to unity. If, then, at any time in an analysis 
the sum of the values obtained for (crzlcrz)^ equals unity, one may be 
certain that the period analysis is over. Strictly speaking, owing to 
the approximations involved in the artifice employed and those occur- 
ring in Eqs: 4 and 5, one may expect Eqs, 8 and 9 to be only approxi- 
mately fulfilled. What the expected relations are for certain other types 
of periodicities is the subject of a problem at the end of the chapter. 

An approximate amplitude a may be obtained more directly. From 
the of an array that yields a maximum czI(Jz one may take for its 
value one-half the difference between the greatest and the smallest 
values algebraically considered. However, the value thus obtained will 
be exact only if the chosen correspond to a maximum and a minimnTn 
for some particular component of the z of Eq. 1, if the number of items 
is sufficient to insure that the contributions of the other components to 
the various are strictly equal, and if the corresponding T is just 
equal to an mr. Within its limitations, this method of obtaining an 
amplitude has considerable value. 

3. Application of Theory to Determinations of Periods. Data for a 
function possessing two sinusoidal periodicities such as the z^oi Eq. 1 
are given in Table I and graphed in Fig. 1. Let us apply the theory 
of the preceding section to this data to obtain values for T' and T/' and 
then later to evaluate a' and a". 

Inspection of Table I shows positive maxima occurring at roughly 
regular intervals. In terms of r, the intervals in succession are 9, 7, 
9, 7, 9, 9, 7, 9, 7, and 9. One of the periods, T' say, would seem to be 
about equal to 8 sec. Let us make this assumption and construct 
Table II in accord with array A. (In what follows the reading 2 ; == 0 for 
t = 0 sec has been inadvertently omitted. That such is the case is of 
no material importance, however.) ^ Should it have been difficult or 
impossible to obtain an approximate value for T' by inspection, it would 



DETERMINATION OF PERIODS 


299 


be necessar}^ to assume various values for and to determine in an 
exploring way, using perhaps a part only of the data and the method 
that follows, regions where the periodicities are actually located. Simple 
inspection has eliminated such exploration. 

Computations, made in accord with the preceding section, when ap- 
plied to the array of Table II, yield the values showm for 2 , Z', 
and the ratio crz'Aa- determining the cr’s, it is well to use the short 
method of Chapter VII, Eq. 13, namely 



Inspection of Table II show’s that maxima tend to shift from columns 2 
and 3 to columns 3 and 4 as w’e progress through the table. It would 



Tinne in Seconds ( i ) 

Fig. 1. Graph of the non-harmonic periodic fimction representing the data of Table I. 

seem probable that if the effective value for T' vrere made equal to 8.1 
sec or 8.2 sec, the greatest possible range for the values of Z' might be 
obtained and possibly the greatest possible values for <rz' and for o-z'/f^z- 
With the above in mind, let us construct Table III on the assumed 
basis that T' = 8.20 sec. In so doing it is necessary to include the range 
of 82 readings rather than 80, as w’as done in Table 11. Two readings 
of the 82 must be eliminated. The basis for selecting the readings to 
be dropped follows. Starting with the assumption that the first reading 
is exactly in phase for an assumed cycle covering 8.20 sec, one sees that 
the phases of the next several readings lead progressively with respect 
to the readings that would be used were they available for regular 
intervals 1.02 sec (= X 8.20 sec) long. Nevertheless the readings 
available are used in succession until it happens that by omission of 
some one reading the phase difference, thereafter for a time a phase lag, 
is reduced. Some reflection will show that, where there are n positions 
in the array and that r numbers from a total of n + r numbers are to 
be dropped on the basis of a minimum for the sum of the phase differ- 
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ences, the positions of drop in the sequence of n + r numbers are given 
by the fractions n/2r + 1, + 2, 5n/2r +• 3, etc. Thus for an 

array of 80 with two numbers to be dropped out of a sequence of 82 

TABLE I 

Values, Unifokmly Spaced in Time, for a Non-harmonic Function 
OF THE Type Shown in Eq. 1, and Their Squares 


[The * indicates maximum values. The arbitrary time interval r, elapsing between successive readings 

is 1.00 sec] 


t 

(sec) 

z 


t 

(sec) 

z 

z^ 

t 

(sec) 

z 


0 

0 

0 

29 

- 46 

2,116 

58 

+ 86 

7,396 

1 

+116 

13,456 

30 

- 87 

7,569 

59 

+144* 

20,736 

2 

+ 133* 

17,689 

31 

-115 

13,225 

60 

+ 86 

7,396 

3 

+ 52 

2,704 

32 

- 16 

256 

61 

- 19 

361 

4 

- 43 

1,849 

i 33 

+ 65 

4,225 

62 

- 80 

6,400 

5 

- 77 

5,929 

34 

+ 78* 

6,084 

.63 1 

- 72 

5,184 

6 

- 59 

3,481 

35 

+ 50 

2,500 

64 

- 40 

1,600 

- 7 

- 37 

1,369 

36 

+ 29 

841 

65 

- 21 

441 

8 

- 24 

576 

37 

- 4 

16 

66 

0 

0 

9 

+ 9 

81 

38 

- 30 

900 

67 

+ 51 

2,601 

10 

+ 74 

5,476 

39 

. - 87 

7,569 

68 

+104* 

10,816 

11 

+ 114* 

12,996 

40 

-108 

11,664 

69 

+ 90 

8,100 

12 

+ 68 

4,624 

41 

- 32 

1,024 

70 

9 

81 

13 

- 50 

2,500 

42 

+ 90 - 

8,100 

71 

-121 

14,641 

14 

-143 

20,449 

43 

+150* 

22,500 

72 

-143 

20,449 

15 , 

-122 

14,884 

44 

+ 90 

8,100 

73 

- 50 

2,500 

16 

- 7 

49 

45 

- 35 

1,225 

74 

+ 73 

5,329 

17 

+ 97 

9,409 

46 

-115 

13,225 

75 

+122* 

14,884 

18 

+110* 

^ 12,100 

47 

! - 97 

9,409 

7G 

+ 77 

5,929 

19 

+ 51 

2,601 

48 

- 27 

729 

77 

+ 3 

9 

20 

- 9 

81 

49 

+ 24 

576 1 

78 

- 36 

1,296 

21 

- 33 

1,089 

50 

+ 39 

1,521 

79 

- 44 

1,936 

22 

- 44 

1,936 

51 

+ 50 

2,500 

80 

- 55 

3,025 

23 

- 66 

4,356 

52 

+ 68* 

4,624 

81 

T 67 

4,489 

24 . 

- 70 

4,900 

53 

+ 56 

3,136 

82 

- 35 

1,225 

25 

- 14 

196 

54 

- 18 

324 

83 

+ 52 

2,704 

26 

+ 85 

7,225 

55 

-112 

12,544 

84 

+129* 

16,641 

27 

+140* 

19,600 

56 

-128 

16,384 

85 ' 

+113 

12,769 

28 

+ 84 

7,056 

57 

- 44 

1,936 

86 

- 2 

4 


numbers, the numbers to be dropped are the 21st and 62nd. Table III 
shows the data of Table I arranged thus on the assumption that T' == 
8.20 sec. One sees at once from the positions of the maxima and from 
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the correspondingly increased value for crz'/<^z that this second guess 
regarding T' is much better than the first. 

Results from treatment sunilar to the above for additionar assumed 
values for T' of 8.10, 8.30, and 8.50 sec added to those shown in Tables 

TABLE II 

The Data of Table I Arranged Similar to Array A on the Assumption that 

r = 8.00 Sec 


[The numbers at the bottoms of the eolmnns are the mean Z’'s. As in Table I, * indicate a positive 
maximum. The value for t — 0 sec has been inadvertently omitted] 


+116 

+ 133 * 

+ 52 

- 43 

- 77 

- 59 

- 37 

- 24 


+ 9 

+ 74 

+ 114 * 

+ 68 

- 50 

-143 

-122 

- 7 


+ 97 

+ 110 * 

+ 51 

- 9 

- 33 

- 44 

- 66 

- 70 i 

= f '= + 2 ., 

- 14 

+ 85 

+ 140 * 

+ 84 

- 46 

- 87 

-115 

- 16 

= 64.4 

+ 65 

+ 78 * 

+ 50 

+ 29 

- 4 

- 30 

- 87 

-108 

- 32 

+ 90 

+ 150 * 

+ 90 

- 35 

-115 

- 97 

- 27 ^ 

= 77.8 

+ 24 

+ 39 

+ 50 

+ 68 * + 56 

- 18 

-112 

-128 

- 44 

+ 86 

+ 144 * 

+ 86 

- 19 

- 80 

- 72 

— 40 

= 0.828 

- 21 

0 

+ 51 

+ 104 * + 90 

- 9 

-121 

-143 

- 50 

+ 73 

+ 122 * 

+ 77 

+ 3 

- 36 

- 44 

- 55 


+ 15.0 

+ 76.8 

+ 92.4 

+ 55.4 - 11.5 

- 62.1 

- 87.3 

- 61.8 



TABLE III 

The Data of Table I Arranged Similar to Array A on the Assumption that 

T = 8.20 Sec 


[The numbers at the bottoms of the columns are the mean Z''s, As in Tables I and II, * indicates a 

positive maximum] 


+116 

+ 133 * 

+ 52 

-43 

- 77 

- 59 

- 37 

-24 



+ 9 

+ 74 

+ 114 * 

+68 

- 50 

A 43 

-122 

- 7 



+ 97 

+ 110 * 

+ 51 


- 33 

- 66 

- 70 

-14 

2 — 

Z '= + 2.2 

+ 85 

+ 140 * 

+ 84 


- 87 

-115 

- 16 

+65 



+ 78 * 

+ 50 

+ 29 

- 4 

- 30 

- 87 

-108 

-32 

( xz ' = 

68.9 

+ 90 

+ 150 * 

+ 90 

-35 

-115 

- 97 

- 27 

+24 

o-z = 

77.6 

+ 39 

+ 50 

+ 68 * 

+56 

- 18 

-112 

-128 

-44 



+ 86 

+ 144 * 

+ 86 

-19 

- 80 

- 40 

- 21 

0 

trz ' 

0.888 

+ 51 

+ 104 * 

+ 90 

- 9 

-121 

-143 

- 50 

+73 

o-z 


+ 122 * 

+ 77 

+ 3 

-36 

- 44 

- 55 

- 67 

-35 



+ 77.3 

+ 103.2 

+ 66.7 

- 7.7 

- 65.5 

- 91.7 

- 64.6 

+ 0.6 



II and 

III are given 

in Table IV. 

Plotted (Fig. 2), 

the < 

curve for 


(rz'/<^z = f{T) shows a maximum at about 8.18 sec. This is the period 
of the dominant frequency present. It is more difficult but not impos- 
sible to estimate the period of the less dominant frequency by inspec- 
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tion. LooMng at Table I, one notes very high values of f{t) at i = 27 
sec and t = 43 sec and only one inteinrening positive maximum at 
t = 34 sec. This maximum is much reduced in magnitude and is nearly 
midway between the other two. Further, there are two negative max- 
ima in this interval, one each side of the midpoint, and both are inter- 
mediate in value. The simple explanation is that both periodicities had 

TABLE IV 

Ceetain Values Computed prom the Data of Table I on the Basis 
OP Various Assumed Periodicities Present 


T 

( sec ) 


(^max ^min) 
2 

a-z 


2^ 

<73 

8.00 

+2.1 

89.8 

77.8 

64.4 

0.828 

8.10 

+1.7 

90.9 

78.1 

68.1 

0.872 

8.20 

+2.2 

97.4 

77.6 

68.9 ■ 

0.888 

8.30 

+2.3 

81.8 

76.6 

61.9 

0.808 

8.50 

-0.3 

73.0 

78.5 

52.7 

0.671 

5.00 

+1.8 

19.2 

77.8 

14.1 

0.181 

5.12 

+2.4 

33.0 

77.7 

27.1 

0.349 

5.19 

+2.0 

43.2 

77.2 

34.2 

0.443 

5.25 

+2.6 

39.2 

78.1 

30.0 

0.384 

5.31 

+0.6 

37.2 

77.9 

28.9 

0.371 

5.38 

+2.7 

16.0 

80.1 

13.4 

0.167 

6.00 

+3.0 

4.5 

• 78.5 

3.1 

0.040 


separate positive maxima near the 27 and the 43 positions, that, though 
the 8.18 sec frequency had a positive maximum near the 34 position, 
the less dominant frequency had a negative maximum at that point, 
and that three periods of the unknown frequency are approximately 
equal to two of the known. We should therefore expect the T" of the 
less dominant frequency to be between 5.0 and 5.5 sec. In accord with 
the expectancy just deduced, computations based on various assumed 
values for T'\ as shown also in Table IV and Fig. 3, indicate the period 
of this frequency, despite the failure of one point to conform with the 
others, to be about 5.19 sec. 

The results for an assumed T'' of 6.0 sec (Table IV) at some distance 
from 5.19 sec show very definitely that that frequency is not present. 
That the plots of Figs. 2 and 3 should give such definite indications 
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is somewhat a matter of chance. For realh" satisfaetor3" work, more 
readings per c^'cle and a greatty increased number of c^Tles are desired. 

Comparison of (crz^/ \^ith (crz^/cf^ on the bases of Eqs. 8 and 9 
indicates (1) that the amplitude for the dominant frequenc}^ is twice 

0.90 

0.8D 

<Jz 

0.70 


8.0 8.1 8.2 8.3 8.4 8.5 

Assumed Periods in Seconds 

Fig. 2. Values computed, using the data of Table I and Fig. 1, for for various 
assumed periods in the. neighborhood of S.2 sec. 

that for the less dominant frequency and (2) that no additional fre- 
quency having an appreciable amplitude is present. Except for the fact 
that these periodicities are sinusoidal, these conclusions could not be 
deduced without further consideration (see problem 2). 

That the peaks of Figs. 2 and 3 are not more definitely resolved than 
they are is a consequence of the relative smallness of the number of 
terms given in Table I. Were the number doubled the resolution would 
be effectively doubled. The effect is the same as in the resolution of 




5.0 5.1 5.2 5.3 5.4 

Assumed Perkjds in Seconds 


Fig. 3. Values computed, using the data of Table I and Fig, 1, for for various 

assumed periods in the neighborhood of 5.2 sec. 

spectral lines by a grating; the greater the number of grating lines, other 
things the same, the greater is the resolution. 

An alternate procedure for determining T" consists (1) in subtracting 
from the data of Table I values for an assumed periodicity of 8.18 sec 
whose amplitude is 97.4 and whose phase is zero for t = 43 sec, and (2) 
in treating the results thus obtained in the manner that the original 
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data liave been treated. This entails more work than the inspection 
method and normally would be used only in case the latter fails. 

4. Determining the Amplitude and Phase Constants. It is advisable, 
in view of the results already gained by inspection, to attempt its appli- 
cation further. Looking over Table I once more, it is found that an 
absolute positive maximum value for z occurs at position 43. Further, 
the values of z for positions 42 and 44 are equal at least to within one 
part in 90. This suggests, despite, if not more strongly because of, the 
readings for positions 58, 59, and 60, that 

a' + a" = 150 [11] 

and that, if t were taken as zero at position 43, then 

(sy = (n' = l] [12] 

^j42 sec 

Eq. 11 combined with the conclusion reached above that a'/a" equals 
approximately 2, leads to the conclusion that a' and may have the 
values 100 and 50 respectively. It is a simple matter to transfer to a 
time origin corresponding to that used in constructing Table I. Doing 
so, we find that 

[5' = -2°l=o [13] 

[5" = -2°l=o [14] 

From the inspectional analysis we therefore conclude as an approxi- 
mate expression 

2 = 100 sin i - 2°) + 50 sin ( — ^ t - 2°) [15] 

\8.18sec / \5.19sec / ^ 

Let us compare Eq. 15 with what is obtained by a much more extended 
determination of the four constants a', a", 5', and 5" by what we ordi- 
narily consider the ''straightforward'' mathematical method, which fol- 
lows. We shall make the same assumption as above, namely, that a 
is zero. Although Table IV by its average values for z seems to indicate 
that a may be of the order of +1.5, this may well be a consequence of 
the small number of terms. 

For the evaluation of the constants on the proposed basis, it is neces- 
sary to rewrite Eq. 1 in the following form 

2x 

z = a + (a' sin S') cos — i + (a' cos S') sin i 

+ (a" sin S") cos — t + (a" cos S") sin ^ t [16] 
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In this foiTn the constants to be determined are a, a' sin 8\ a' cos 8\ 
a'' sin and a'' cos y'. Selecting five points from Table I, and insert- 
ing the appropriate values for z and t, together vdth the determined 
values for T' and T", in Ecp 16 leads to five simultaneous linear equa- 
tions connecting the desired constants. Values for them may be deter- 
mined by standard methods. 

The authors, assuming a of Eq. 5 to be zero, have carried through 
such computations. The points selected corresponded to t equal to 7, 
18, 34, and 36 see. In theoiy any four points could be chosen. These 
were chosen on the basis that for these, position z varied but slowly 
vith t. The resultant computed equation is 

z = 85.0 sin t + 250°) + 47.9 sin t + 167°) [17] 

The constants of Eq. 17 do not check well (1) mth the conclusion, 
drawn in connection with Table IV and Eq. 8, that the amplitude of 
the first component is twice that of the second, (2) with the original 
data of Table I which shoves at 43 sec that the sum of the tw^o ampli- 
tudes must be equal at least to 150, nor (3) with the original equation 
used in the construction of Table I, namely 

2t 2x 

z = 100.0 sin — ^ + 50.0 sin — t [18] 

Eq. 15 arrived at by the inspection method fits much more nearly 
with the construction equation, Eq. 18, than does Eq. 17, which was 
arrived at by straightforward mathematical procedure. That the latter 
method should fail can be explained on the basis of propagation of pre- 
cision indexes (Chap. IX). It perhaps suffices here to say that certain 
procedures, starting with given quantities with moderate given precision 
indexes, tend toward highly precise results for certain other computed 
quantities when carried through in a so-called forward direction, and 
that those same procedures will tend tow^ard greater uncertainty of 
results if the direction is reversed and the former initially given quan- 
tities are now the quantities sought in the reversed procedure. Evalu- 
ating a', a", and 8" in terms of given z and T and T" is such a back- 
ward procedure when contrasted with the forward procedure of finding 
z, given those constants. 

Failing the benefits of an inspection or other method, the best proce- 
dure for finding the best equation of the type of Eq. 1 would seem to 
be that of (1) accepting an equation such as Eq. 17 as prel imin ary, (2) 
plotting the resulting curve of deviations, (3) computing the resulting 
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variations for this curve due to separate small variations of T', T", 
a', a", 5^, and 5", and (4) adjusting the values of these constants to 
yield a minimum standard deviation in accord with Gaussian theory. 

Even -with the benefits of assumed possible inspectional method, ad- 
justments in accord wdth the preceding paragraph may be necessary. 

6. Smmnaiy. Certain problems involve variations of two or more 
components each having a periodicity of its own unrelated to that of 
the other. When only the added effects of these periodicities can be 
measured, there is need of a procedure for their separate determinations. 

Granted a disturbance of the type 

z = a + a' sin t + S'^ + a" sin t + 5"^ + ■ [1] 

and data for z for a long series of equally spaced instants of time, r, 
one first inspects the tabulated data to determine an approximate period 
for one periodicity. If an approximate period is not obtainable thus, 
one must be assumed. 

With a definite assumption of period as mV where m' is a whole 
number, the data are arrayed as follows: 


^1 

^2 

23 

2m' 



2m' +3 

* * 22m' 


22m' 4-2 

22 m' 4-3 

23m' 

Z'l 

^'2 

Z's • • 

Z'.r. 


of which the Z'^s represent the averages of the corresponding columns. 
For this array the ratio of two standard deviations is sought, namely 
(xz'/<Tz. If this ratio is zero or approximately zero, mV is not a period 
present in the data nor is it approximately such period. If, however, 
this ratio differs from zero considerably, a period near mV is present. 
It then becomes necessary to array the data corresponding to periods 
of (m' ± €')r of which e' is a proper fraction. The procedure for this, 
involving the elimination of certain of the ^’s according to an ordered 
plan, is described in the text. The ratios for several such arrays 
are separately determined. The value of (m^ it e'^)r corresponding to 
a maximum for this ratio is a frequency sought. Other frequencies are 
similarly determined by seeking maxima of the ratio in other regions of 
assumed frequencies. 
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In case the periodicities are sinusoidal the ratios crz/crg are in propor- 
tion to their amplitudes and the sum of their squares is unity. Pro- 
cedures for determining actual amplitudes and phase relations for the 
component periodicities are discussed. 


PROBLEMS 

1. Taking from the data of Table I those which are necessary separately for 13 
and 14 cycles, compute two values for ( tz»/gz corresponding to T" = 5.31 see. .What 
is your conclusion? 

2. WTien two periodic functions of the straight-side saw tooth type with dijfferent 
frequencies and amplitudes are combined, what are the expected relations corre- 
sponding to those of Eqs. 8 and 9? WTiat generalization may be made? 
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BRIEF DISCUSSION OF DETERMINANT METHODS 


Introduction. Throughout this text determinants are used (1) in the solu- 
tion of simultaneous equations and (2) in the deternimation of the equations of 
curves of selected types that pass through selected points. To the authors they 
represent much time saved and simplified, generalized procedures. Recognizing, 
however, that many users of this text will not have the necessary preparation, 
simple though it is, we here present without discussion of underlying theory the 
simple procedures for carrying out the two processes indicated above. 

The Solution of Simultaneous Equations. Consider the determinant solu- 
tion for the following three equations. 


Zx + 2y — a = 19 
2a; - 6i/ — s = 7 
5a; — 4^/ + Zz — 1 

In determinant form they are 

19 2 -1 

7 -6 -1 

1 -4 3 

X = 

3 2-1 

2 -6 -1 

5-4 3 


3 19 -1 

2 7 -1 

5 1 3 



z 

3 2-1 

2 -6 -1 

5 -4 3 

309 


[ 1 ] 

[ 2 ] 


[ 4 ] 


[5] 


[ 6 ] 
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The denoniiiiators are the same’ and consist of a determinant composed of the 
coefficients of x, y, and s in Eqs. 1, 2, and 3 arrayed in the order appearing there. 
The numerator determinant for x differs only in that the coefficients of x in 
Eqs. 1, 2, and 3 are replaced by the numerics on the right of the equality signs. 
The numerators for y and z are similarly determined. In case there are four 
or more unknowns, expressions similar to the above may be written for their 
values. Each unknown will be represented by the ratio of two determinants. 
For the convenient evaluation of these determinants, there are several rules 
which we shall discuss in general terms previous to obtaining the numerical 
values ordinarily desired for the three unknowns. 

The Evaluation of Determinants. Let us consider in succession the gen- 
eralized procedures for evaluating determinants of the (1) second, (2) third, and 
(3) higher orders. 

The standard form for the second order determinant and its algebraic equiv- 
alents are shown in the following equations: 


ax 

hi 62 


= (^162 — 02&1 


m 


The standard form for a third order determinant is 


ci2 ciz 
hi &2 hz 
Cl C 2 C 3 


[A] 


There are two convenient methods to evaluate it. 

According to one method, the operator either draws, or sees drawn in his 
mind’s eye, lines as indicated in the following form: 


[B] 


In the evaluation the determinant is equated to the sum of the products of items 
connected by the lines. In this equating one takes as positives the products, of 
terms connected by the lines sloping generally downward to the right and as 
negative the products of terms connected by the lines sloping generally down- 
ward to the left. Thus we have 



€Ll CL2 

^1 &2 hz = d-ibzCz “b dL^iC 2 — o,jbzC 2 — o>^iCz — 0^362^1 [8] 

Cl C2 Cz 

As a general characteristic of the terms of the algebraic equivalent of the deter- 
minant, it is seen that each row and column is represented in every such term. 
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The second method is based on the breaking up of the determinant into second- 
order determinants as follows: 


dl Q>2 CLz 

hz 

Cl C2 Cz 



&2 hz 


61 bz 


hz 

dl 


- d2 


+ da 



C 2 Cz 


Cl Cz 


Cl C 2 


[ 9 ] 


Expansion of these second-order determinants leads at once to the expression 
given above. These smaller determinants in order are called minors of the 
terms ai, a2, and az. Note that, in the expansion of the main determinant in 
terms of minors, the signs are alternately positive and negative and that the 
first sign is positive. For the one who makes considerable use of determinants, 
the first method is commonly used when a determinant of the third order is to 
be evaluated. 

Consider next the evaluation of a determinant of the fourth or higher order. 
The method of Array B cannot be used. Instead we use that given above as the 
second method for the third order determinant. Thus we have 


dl d2 Us d 4 
hi &2 hz 64 
Cl C2 C3 C4 

dl dz dz di 



hz hz 64 


hi hz hi 


hi hz hi 


hi hz hz 

dl 

C2 Cz C4 

— az 

Cl Cz Ci 

+ d 3 

Cl Cz Ci 

- Ui 

Cl Cz Cz 

i 

dz dz di 


dl dz di 


dl dz di 


didz dz 


[ 10 ] 


of which the third order determinants are to be. evaluated as above. Note the 
alternate changing of signs. Writing \aih2€zdA\ for the main determinant and 
Ai, A2, As, and A4 as the minors to the elements ui, 02, az, and 04, we have as 
an abbreviated form 

\(l^b2pzd/^ — Ulxli — 02*42 + U 3 A 3 — QaAa [n] 


According to another method of breaking up, we may write 

\aih2Czdi\ aiAi — biBi A- CiCi — diDi [12] 


There are six other methods in fact. Based for instance on the second column, 
we write 

\aib2Pzdi\ = — d2A.2 + hPt — C2C2 + ^2^2 [ 13 ] 

The sign of any term depends on the location in the determinant of the item 
preceding the minor. These are shown in the following array: 
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Rtales for the Simplification of Determinants. The time required to evalu- 
ate a determinant is often iniich lessened by the application of certain rules 
which we shall state without giving proof. They are: 

(1) If, from a^row or column of a determinant, a common factor may be 
removed, that determinant may be equated to the produet of that factor and 
the determinant with that factor eliminated from the row or column in ques- 
tion. Thus 

I 3 2 -1 I I 3 1 -i 

I 2 -6 -1 I = 2 I 2 -3 >1 [14] 

•5 ' —4 3 i 

(2) The elements of one row or column may all be multiplied by a constant 
and added to or subtracted from the corresponding elements of another row or 
column without changing the value of the determinant. Thus 

31-1 31 -1 _ 3 1 -1 

2 -3 -1 -1 -4 0 = -1 -4 0 [15] 

5 -2 3 i 5-2 3 14 1 0 

The first row was first subtracted from the second and then multiplied by 3 
and added to the last row. The advantage for the evaluation has been the intro- 
duction of zeros. 

(3) If the elements of a row- or a column of a determinant are all zeros with 
one exception, the determinant may be equated to the product of that element 
and its minor with the appropriate sign derived from array C. Thus w^e have^ 


3 1 -1 

-1 -4 0 

14 10 


-1 -4 1 4 

14 1 14 1 


[16] 


the last step following rule 1. Evaluated in accord with Eq. 7, the last deter- 
minant yields —55. Accordingly the original determinant of Eq. 14 and the 
denominators of Eqs. 4, 5, and 6 are equal to —110. 

(4) If two rows or tw'o columns of a determinant are equal or the elements 
of one are in direct proportion to those of the other, the value of the deter- 
minant is zero. Thus 

4 2 I i 6 4 2 

8 4 3 8 4 3 = 0 [17] 

9 6 3 0 0 0 


a consequence in fact of rule 2 and of the general characteristic of the terms to 
which a determinant may be equated as noted above in connection with Eq. 8, 
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Applying the general and special rules for the evaluation of the determinants 
of Eqs. 4, 5, and 6, one obtains 


-440 , 

[18] 

a; = = 4 

-110 

-no 

[19] 

y = =1 

^ -no 

550 

[20] 

2 = = -5 

-no 


Were aU sets of simultaneous equations which are to be solved of do higher 
order than three and were the coefficients always simple whole numbers, it is 
doubtful that the time~sa\dng feature of determinants would be of much value. 
When, however, the order is higher than three and the coefficients are not 
simple, there is no question but that the determinant method is advisable. 

There are additional special rules which have been developed and proved. 
We shall not have need for them, however. 

Equations of Specific Curves by the Determinant Method. The determi- 
nant procedure for the determination of the equation of a specific curve is the 
same whatever the general form may be. For the straight line of the form 

y + a + lx = Q [ 21 ] 

passing through points (3,5) and (6,2), for instance, the equation is 

y I X 

5 13=0 [22] 

2 1 6 

Reduced to an algebraic form in conformity with the procedures and rules 
outlined above, this yields 

y — 8 -f- n = 0 [23] 

For the third-degree equation of the form 

y + a + hx-^-cx^ + dbi^^^O [24] 

passing through four points (corresponding to the four arbitrary constants) 
namely (0,2), (2,5), (4,10), and (6,12), the equation is 

y lx 3^ 

2 10 0 0 

5 1 2 4 8 [25] 

10 1 4 16 64 

12 1 6 36 216 

The determination of the algebraic form is left to the reader. 
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For an equation of the form 

+ ay + h + cx + ds? — ^ [26] 

passing through the points listed above for Eqs. 24 and 25 the equation is 
similarly 

2/2 y I X 

4 2 10 0 

25 5 1 2 4 = 0 [27] 

100 10 1 4 16 

144 12 1 6 36 

The determination of the algebraic form is left to the reader. 

The occurrence of a column each element of which is unity may be slightly 
disturbing at first- Its presence is understood when it is seen that these de- 
terminants are composed entirely of the coefficients of the undetermined con- 
stants and of the constant arbitrarily taken as unity and that the so-called 
constant term of Eq. 26 for instance may be viewed as hx^ or or a combina- 
tion and that and y^ are unity. 

Often in the determination of equations, the operator may select certain con- 
venient points for his purpose. So doing, the necessary computations may be 
greatly abbreviated. If additionally certain simplifying changes of variables 
may be employed, an additional reduction in computational effort sometimes 
results. Illustrating these procedures, we shall consider the data of Table I 
wherein is presented the time-temperature relation for the constantly stiried 
Hquid of a calorimeter to which heat was supplied electrically at a constant rate. 

TABLE I 

Data Showing the Time-Temperature Relation for the Liquid of a 
Calorimeter Supplied with Heat at a Constant Rate 


t in min 

Tin °C 

t in rnin 

Tin "C 

0 

, 20.95 

9 

34.65 

1 

22.60 

10 

36.10 

2 

24.20 

11 

37.50 

3 

25.75 

12 

38-90 

4 

27.30 

13 

40.30 

5 

28.80 

14 

41.70 

6 

30.30 

15 

43.05 

7 

31.75* 

16 

44.40 

8 

33.20 




Let the purpose be that of determining values of dT/dt for various temperatures 
such as 25® C, 30® C, 35® C and 40® C. We first seek T — f{t) and for the rela- 
tion let us assume 


T “ To + of -f 


[ 28 ] 
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Making nse of the selected-points method, which is described fully in Chapter 
III of the text, we select points corresponding to 2 min, 8 min, and 14 min as 
fairly representative of three roughly equal groups into which the data may be 
divided. The determinant equation, disregarding the units of measurement, 
that results is 

T 1 i f 

24.20 1 2 4 

33.20 1 8 64 

41.70 1 14 196 

This may be solved directly, but let us introduce certain new simplifying, di- 
mensionless variables, e.g. 

T - 33.20° C 

1C- ™ 

and 

i-8^ 

6 mm 

Rewritten, Eq. 29 becomes 


-9.00 1 -*11 
.00 1 0 0 
8.50 1 11 


This simplifies at once, in view of rule 3 above, to 


which at once reduces to 


-9.00 -11 =0 

8.50 1 1 

y = 8.75a; - 0.25a;2 


Verification shows that no computational error has been made. How well the 
equation fits the data as a whole may be determined easily. Differentiation 
leads to 

^ = 8.75 - 0.50a: [35] 


For dTJdt^ the quantity desired, we have 


dT __ dy dx dT 
(M dx dt dy 


[ 36 ] 
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Substitution, for tie condition tiat t = 5 min, leads to a desired result, namely 

f = (8.75 + 0.25) „ \ 1 C“ = 1.50 ^ [37] 

\dtj 5 min 6 min min ^ ^ 

Other values for dT/dt follow quickly. Obviously with slight practice, one will 
see that the writing dowm of Eqs. 29 and 32 is needless. Possibly also he will 
be able to obtain Eq. 34 from Eq. 33, if written at all, by inspection. It is 
evident, however, that the selection and the change-of-variables procedures may 
simplify computations greatly. 


PROBLEMS 

1. Solve the following equations for x, y, and z. 

2x + ^y + z - 0 

a; + 2/ + 22 = 5 

X — z - 2 

2. Solve the following equations: 

w +y =^2 
X + y + z ^ 4: 
w + z — 1 

3 . Find equations for straight lines passing through points 
(a) (3,0) and (2,9); 

(h) (0,4) and (6,0); 

(c) (-2,3) and (3,-4). 

4 . Find equations for a line of type y = a + hx +cy? through 

(а) (0,0), (4,6), and (12,6); 

(б) (-3,0), (2,-6), and (7, -10); 

(c) (-3,0), (2,-6), and (7, 2). 

6. Find equations for a circle passing through the points 

(а) (0,0), (2,2), and (4,8); 

(б) (-4,3), (3,-4), and (4,3). 

6. Find the equation of the conic passing through the points (0,0), (2,2), (4,8), 
(2,12), and (-2,8). 

7. (a) Express Eq. 25 in its normal algebraic form. (6) Express Eq. 27 in its 
normal algebraic form. 

8. Using the data of Table I, but selecting values corresponding to 3, 8, and 13 min, 
determine values for dT/dt correspondmg to i = 5 min, 10 min, 15 min. Check the 
value for, 5 min with that given in the text. 

9. Using the data of Table I, determine an equation of the form of T =» 

To + at + to fit the data. Also determine dT/dt for t — 5 min. 
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TABLES 

TABLE 1 1 

The Pbob ability Coefficient foe the Noemal Distetbetton Cukve 
Vhz == AS A Function of hx 

V TT 

Frequently in tables values of 2yhx are given in place of i/a® 

To obtain values of yx/a as a function of a;/<r, determine in order for each given x/tr, 
a corresponding kx (= xl^/2a), a ykx as given by the table, and yx/a (= hryix 
= Vhx/ \/2)* To obtain values of yx/p as a function of x/p, determine in order for 
each given x/p a corresponding fix 0-477 x/p)^ a i/a® as given by the table, and 
a yx/p { — hp ykx = 0.477 i/a®)- To obtain values of yx as a function of one must 
have a value for Jij a, or p. Given h, determine, for each given x, a correspond- 
ing /ix, a ykx as given by the table, and a. yx{- hyhx)^ 


%x 

.00 

.01 

.02 

.03 

I 

• .04 

.05 

.06 

.07 

.08 

.09 i 

Diff. 

0.0 ! 

0.5642 

0.5641 1 

0.5640 

0.5637 

0.5633 

0.5628 

0.5622 

0.5614 

0.5606 

0.5596 

0.0006 

0.1 

.5586 

.5574 

.5561 

.5547 

.5532 

.5516 

.5499 

.5481 

.5462 

.5442 

.0017 

0.2 

.5421 

.5398 

.5375 

.5351 

.5326 

.5300 

.5273 

' .5245 

.5216 

.5187 

.0026 

0.3 

.5156 

.5125 

.5093 

.5060 

! .5026 

.4991 

i .4956 

i .4920 

.4883 

i .4846 

.0035 

0.4 

.4808 

.4769 

.4730 

.4689 

.4649 

.4608 

I .4566 

.4524 

.4481 

i .4438 

.0041 

0.5 

.4394 

.4350 

.4305 

.4260 

.4215 

.4169 

' .4123 

.4077 

.4030 

.3983 

i .0046 

0.6 1 

.3936 

.3889 

.3841 

.3794 

.3746 

.3698 

.3650 

.3601 

.3553 

.3505 

.0048 

0.7 

.3456 

.3408 

.3360 

.3311 

.3263 

.3215 

.3166 

.3118 

1 .3070 

.3023 

! .0048 

0.8 

.2975 

,2927 

.2880 

.2833 

.2786 

.2739 

.2693 

.2647 

1 .2601 

.2555 

.0047 

0.9 

.2510 ^ 

.2465 

.2420 

.2376 

.2332 

.2288 

.2245 

.2202 

i .2159 

! 

.2117 

1 .0043 

1.0 

.2076 

.20^ 

.1993 

.1953 

.1913 

.1873 

.1834 

.1796 

.1757 

.1720 

1 .0039 

1.1 

.1682 

-1646 

.1609 

.1574 

.1538 

.1503 

.1469 

.1435 

.1402 

.1369 

i .0035 

1.2 

.1337 

.1305 

.1274 

,1243 

,1212 

.1183 

.1153 

.1124 

.1096 

; .1068 

i .0030 

1.3 

.1041 

.1014 

.0988 

.0962 

1 .0937 

.0912 

.0887 

.0864 

.0840 

: .0817 

i .0025 

1.4 

.0795 

.0773 

.0751 

.0730 

,0709 

.0689 

,0669 

.0650 

.0631 

.0613 

1 .0020 

! 

1.5 

.0595 

.0577 

.0560 

.0543 

.0527 

.0511 

.0495 

.0480 

.0465 

.0450 

i .0016 

1.6 

.0436 

.0422 

.0409 

.0396 

.0383 

.0371 

! .0359 

1 .0347 

.0335 

.0324 

1 .0012 

1.7 

.0314 

.0303 

.0293 

.0283 

.0273 

.0264 

.0255 

.0246 

.0237 

1 .0229 

.0009 

1.8 

.0221 

.0213 

.0206 

.0198 

.0191 

.0184 

.0177 

.0171 

.0165 

.0159 

.0007 

1.9 

.0153 

.0147 

.0141 

.0136 

.0131 

.0126 

.0121 

.0116 

.0112 

.0108 

.0005 

JlS 

0.0 

0.1 

0.2 

1 

0.3 

0.4 

0.5 

0.6 

0.7 

0,8 

0.9 

Diff. 

2.0 

.0103 

.0069 

,j 

.0045 i 

.0028 

.0018 i 

.0011 

.0007 1 

.0004 

.0002 

.0001 

.0010 


1 This table ts based on T^Hes of ProbahHity Fumiions, VoL 1, Federal Works Agency, Work Projects 
Administration for the City of New York, 1&41, sponsored by the National Bureau of Standards. 
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TABLE IP 

Vaiubb of the Probabilitt Integral Pi* 

AS a Ftotction of hx 

Frequeatly in. tables, this integral is designated by P 
given x/e limit is the Phx of the table which corresponds to the As (= xI-s/2<t) 
for the given x/e limit. The F*/p corresponding to a given x/p limit is the of 
the table which corresponds to the Ac ( = 0.477 x/p) for the given x/p limit. The 
Px corresponding to a given x-limit is obtainable only if the appropriate value for h, 
or p is knoTO. Given A, it may be read from the table as the Phx corresponding 
to the kc for the given a;4imit. 


V -1 

The Px/ff corresponding to a 


hx 

.00 

.01 

,02 

.03 

.04 

.05 

.06 

.07 1 

.08 

.09 

DifP. 

0.0 

0.0000 

0.0113 

0.0226 

0.0338 

0.0451 ; 

0.0564 

0.0676 

0,0789 

0.0901 

0.1013 

0.0112 

0.1 

.1125 

.1236 

.1348 

.1459 

.1569 

.1680 ; 

.1790 

.1900 

.2009 

.2118 

.0110 

0.2 

.2227 

.2335 

,2443 j 

.2550 ! 

.2657 

.2763 

.2869 

.2974 

.3079 

.3183 

.0106 

0.3 

.3286 

.3389 ! 

.3491 

.3593 

.3694 

.3794 

,3893 

.3992 

.4090 

.4187 

.0100 

0.4 

.4284 

.4380 

.4475 

.4569 

.4662 

.4755 

.4847 

.4937 

.5027 

.5117 

.0092 

0.5 , 

.5205 

.5292 

.5379 

.5465 

.5549 

.5633 

.5716 

.5798 

.5879 

.5959 

.0083 

0.6 

.6039 

.6117 

.6194 

.6270 

.6346 

.6420 

.6494 

.6566 

.6638 

.6708 

.0074 

0.7 

.6778 

.6847 

.6914 

.6981 

.7047 

.7112 

.7175 

.7238 

.7300 

.7361 

.0064 

0.8 

.7421 

.7480 

.7538 

.7595 

.7651 

.7707 

.7761 

.7814 

.7867 

.7918 

.0055 

0.9 

.7969 

.8019 

.8068 

.8116 

.8163 

.8209 

,8254 

.8299 

.8342 

.8385 

.0046 

1.0 

.8427 

.8468 

.8508 

.8548 

.8586 

.8624 

.8661 

.8698 

.8733 

.8768 

.0038 

1.1 

.8802 

.8835 

.8868 

.8900 

.8931 

.8961 

.8991 

. .9020 

.9048 

.9076 

.0030 

1.2 

.9103 

.9130 

.9155 

.9181 

.9205 

.9229 

! .9252 

.9275 

.9297 

.9319 

.0024 

1.3 

.9340 

.9361 

.9381 

.9400 

.9419 

.9438 

.9456 

.9473 

.9490 

.9507 

.0018 

1.4 

.9523 

.9539 

,9554 

.9569 

.9583 

.9597 

.9611 

.9624 

.9637 

,9649 

.0014 

1.5 

.9661 

.9673 

.9684 

.9695 

.9706 

.9716 

.9726 

.9736 

.9745 

.9755 

.0010 

1.6 

.9763 

.9772 

.9780 

.9788 

.9796 

.9804 

.9811 

.9818 

,9825 

.9832 

.0007 

1.7 

.9838 

.9844 

.9850 

.9856 

.9861 

.9867 

.9872 

.9877 

,9882 

.9886 

.0005 

1.8 

.9891 

.9895 

.9899 

.9903 

.9907 

.9911 

.9915 

.9918 

.9922 

.9925 

.0004 

1.9 

.9928 

.9931 

.9934 

.9937 

.9939 

.9942 

.9944 

.9947 

.9949 

.9951 

.0003 

kc 

0.0 

0.1 

0.2 

0.3 

0.4 

0.5 

0.6 

0.7 

0.8 

0.9 


2.0 

.9953 

■ 

.9970 

.9981 

.9989 

.9993 

.9996 

,9998 

. .9999 

.9999 

.99995 



1 This table is based on Tables of Probability Functions^ Vol. 1, Federal Works Agency, Work Projects 
Administration for the City of New York, 1941, sponsored by the National Bureau of Standards. 
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TABLE III 

Chatjyenet’s Criterion. Limiting Vaetjes of kx ^ xfar , and x/p Corresponding 
TO Various Numbers of Items, ti, for the Exclusion of an Item from a Set 
ON THE Basis that, in Comparison with the Other Items, it Exerts too Great 
AN Influence on Computed Values 


n 

hx 

x/a 

X;p 

n 

hx 

xfa 

xfp 

5 

1.16 

1.68 

2.44 

20 

1.58 

2.24 

3.32 

6 

1.22 

1.73 

2.57 

22 

1.61 

2.28 

3.38 

7 

1.27 

1.79 

2.68 

24 

1.63 

2.31 

3.43 

8 

1.32 

1.86 

2.76 

26 

1.66 

2.35 

3.47 

9 

1.35 

1.92 

2.84 

30 

1.69 

2.39 

3.55 

10 

1.39 

1.96 

2.91 

40 

1.77 

2.50 

3.70 

12 

1.44 

2.03 

3.02 

50 

1.82 

2.58 

3.82 

14 

1.49 

2.10 

3.12 

100 

1-98 

2.80 

4.16 

16 

1.52 

2.16 

3.20 

200 

2.14 

3.02 

4.48 

18 

1.56 

2.20 

3.26 

500 

2.33 

3.29 

4.88 



Showing Values op Coeresponding to Listed Values op and n', Where n' is the Number op Groups into Which the 

Data are Divided Less the Number op Imposed Conditions 
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For larger valu^ of n, the expression v2x^ — '^2n — 1 may be used as a normal deviate with unit variance. 
1 From R. A. Fisher, Statistical Methods for Research Workers, London, Oliver & Boyd, 1938. 



TABLES 


321 


TABLE 

Showing Valites of Coreelatiox Coefficient r Coeresponding to Vabious 
Values of Fisheb’s z-Function 


z 

.01 

.02 

.03 

.04 

.05 

.06 

.07 

.08 

.09 

.10 

0.0 

0.0100 

0.0200 

0.0300 

0.0400 

0.0500 

0.0599 

0.0699 

0.0798 

0.0898 

0.0997 

0.1 

.1096 

.1194 

.1293 

.1391 

.1489 

.1586 

.1684 

.1781 

.1877 

.1974 

0.2 

.2070 

.2165 

.2260 

.2355 

.2449 

.2543 

.2636 

.2729 

.2821 

.2913 

0.3 

.3004 

.3095 

.3185 

.3275 

.3364 

.3452 

.3540 

.3627 

.3714 

-3800 

0.4 

.3885 

.3969 

.4053 

.4136 ! 

.4219 

.4301 

.4382 

.4462 

.4542 

.4621 

0.5 

.4699 

.4777 

.4854 

.4930 

.5005 

.5080 

.5154 

.5227 

.5299 

,5370 

0.6 

.5441 

.5511 

.5580 

.5649 

.5717 

.5784 

.5850 

.5915 

.5980 

.6044 

0.7 

.6107 

.6169 

.6231 

.6291 

.6351 

.6411 

.6469 

.6527 

.6584 i 

.6640 

0.8 

.6696 

.6751 

.6805 

.6858 

.6911 

.6963 

.7014 

.7064 

.7114 i 

.7163 

0.9 

.7211 

.7259 

.7306 

.7352 

.7398 

.7443 

.7487 

.7531 

.7574 

.7616 

LO 

.7658 

.7699 

.7739 

.7779 

.7818 

.7857 

.7895 

.7932 

.7969 

.8005 

1.1 

.8041 

.8076 

.8110 

.8144 

’.8178 

.8210 

.8243 

.8275 

.8306 

.8337 

1.2 

.8367 

.8397 

.8426 

.8455 

5 .8483 

.8511 

.8538 

.8565 

.8591 

.8617 

1.3 

.8643, 

! .8668 

.8692 

.8717 

.8741 

.8764 

.8787 

.8810 

.8832 

! .8854 

1.4 

.8875 

.8896 

.8917 

: .8937 

: .8957 

.8977 

,8996 

.9015 

.9033 

.9051 

1.5 

.9069 

.9087 

.9104 

.9121 

.9138 

.9154 

' .9170 

.9186 

.9201 

.9217 

1.6 

.9232 

.9246 

.9261 

.9275 

.9289 

.9302 

.9316 

.9329 

.9341 

.9354 

1.7 

.9366 

.9379 

.9391 

.9402 

.9414 

.9425 

.9436 

.9447 

.9458 

.94681 

1.8 

.94783 

.94884 

.94983 

.95080 

.95175 

.95268 

.95359 

.95449 

.95537 

.95624 

1.9 

.95709 

.95792 

.95873 

.95953 

.96032 

.96109 

.96185 

.96259 

.96331 

.96403 

2.0 

.96473 

.96541 

.96609 

.96675 

.96739 

.96803 

.96865 

.96926 

.96986 

.97045 

2.1 

.97103 

.97159 

.97215 

.97269 

.97323 

.97375 

.97426 

,97477 

.97526 

.97574 

2.2 

.97622 

.97668 

.97714 

.97759 

.97803 

.97846 

.97888 

.97929 

.97970 

.98010 

2.3 

.98049 

.98087 

.98124 

.98161 

.98197 

.98233 

.98267 

.98301 

.98335 

.98367 

2.4 

.98399 

.98431 

.98462 

.98492 

.98522 

.98551 

.98579 

.98607 

.98635 

.98661 

2.5 

.98688 

.98714 

.98739 

.98764 

.98788 

.98812 

.98835 

.98858 

.98881 

.98903 

2.6 

.98924 

.98945 

.98966 

.98987 

.99007 

.99026 

.99045 

.99064 

.99083 

.99101 

2.7 

.99118 

.99136 

.99153 

.99170 

.99186 

.99202 

.99218 

.99233 

.99248 

.99263 

2.8 

.99278 

.99292 

.99306 

.99320 

.99333 

.99346 

.99359 

.99372 

.99384 

.99396 

2.9 

.99408 

.99420 

.99431 

.99443 

.99454 

.99464 

.99475 

.99485 

.99495 

.99505 


For greater accurac^y, and for values beyond the table, 
r = (e*® - 1) -5- {e“ + 1) 

K{to<l +r) -InCl-r)} 

1 From R. A. Fisher, Statistical Methods for Research WorkerSf London, Oliver Boyd, 1938, 
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TABLE VI 

Showing the Makeup of the Constants of the Least-Squabes Equation of 

THE Type y - a hx cx- + dx^ for Equations of Varying Degrees When 
the Abbreviated Method of Baily ^ and of Cox and Matuschak ^ is Used 

This method is applicable only when succeeding values of x have a common differ- 
ence and are equally weighted. The independent variable, changed if necessary, 
must have a zero value at the midpoint of the series with succeeding values dif- 
fering by unity if the number of terms is odd and by two if even. Values for the 
various k's, as computed by Cox and Matuschak, are to be found in Tables VII 
and VIII of this appendix. 


Degree of 

Parameters 

Equation 






CL 

h 

c 

d 

1 

k{Zy 

k^xy 



2 

h^y — 

k^xy 

hZx^y — k4Xy 


3 

k^y — k^x^y 

k^xy — k^Zx^y 

k^Lx’^y — k^y 

kzZx^y — hZxy 


1 Baily, J- L., Ann. Mcdh. Statistics, 2, 355 (1931). 

2 Cox, G. J., and Matuschak, M. C., J. Phys. Chem,, 45 , 362 (1941), 



TABLE VII 

Valxjeb op the Constants, hn Entering Least-Squares Solutions Using the Abbreviated Method of Baily and Cox and 

Matuschak, When the Number of Terms, n, is Odd 

The numbers in ( ) show the negative powers of 10 by which the adjacent numbers must be multiplied in order to obtain appropriate knB. 

To illustrate, for n = 13 is 54,945,055 X 
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TABLE VIII 

Yjosoeb of the Constamts, hn, Entering Least-Squares Souutions, Using the Abbreviated Method of Baidy and Cox and 

Matuschak, Whew the Number of Terms, n, is Even 

[See preceding table for the meanings of numbers in ( ). See also Table VI.I 
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TABLE rx 


Sums of Integees aud of Squares of Integers 

m=l 

FOE Use IN L^st-Sqttaees Solutions 



n 

n 


n 

n 

n 



n 

E® 

E”’ 


771=1 

77J=1 


m= 1 

f71 = l 

1 

1 

1 

26 

351 

6,201 

2 

3 

5 

27 

378 


3 

6 

14 

28 

406 

7,714 

4 

10 


29 

435 

8,555 

5 

15 

55 

30 

465 

9,455 

6 

21 

91 

31 

496 


7 

28 


32 

528 


8 

36 

204 

33 

561 

12,529 

9 

45 

285 

34 

595 

13,685 

10 

55 

385 

35 

630 

14,910 

11 

66 

506 

36 

666 

16,206 

12 

78 

650 

37 

703 

17,575 

13 

91 

^9 

38 

741 

19,019 

14 

105 

1,015 

39 

780 

20,540 

15 

120 

1,240 

40 

820 

22,140 

16 

’l36 

1,496 

41 

861 ^ 

23,821 

17 

153 

1,785 

42 

903 

25,585 

18 

171 

2,109 

43 

946 

27,434 

19 

190 

2,470 

44 

990 

29,370 

20 

210 

2,870 

45 

1,035 

31,395 

21 

231 

3,311 

46 

1,081 

33,511 

22 

253 

3,795 

^ . 47 

1,128 

35,720 

23 

276 

4,324 

1 48 

1,176 

38,024 

24 

300 

4,900 

49 

1,225 

40,425 

25 

325 

5,525 

50 

1,275 

42,925 
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APPENDIX 2 


TABLE X 

Logarithms to the Base e 


These two pages give the natural (hy- 
perbolic, or Napierian; logarithms of 
numbers between 1 and 10, correct to 
four places. Moving the decimal point 
n places to the right (or left) in the num- 
ber is equivalent to adding n times 2.3026 
(or n times 3.6974) to the logarithm. 


1 2.3026 1 0.6974-a 

2 4.6052 2 0.3948-5 

3 6.9078 3 0.0922-7 

4 9.2103 4 0-7897-10 

5 11.5129 5 0.4871-12 

6 13.8155 6 0.1845-14 

7 16.1181 7 0.8819-17 

8 18.4207 8 0.S793-19 

9 20.7233 9 0.2767-21 



0 

1 

2 

s 

4 

5 

1.0 

0.0000 

0100 

0198 

0296 

0392 

0488 

1.1 

0953 

1044 

1133 

1222 

1310 

1398 

1.2 

1823 

1906 

1989 

2070 

2151 

2231 

1,3 

2624 

2700 

2776 

2852 

2927 

3001 

1.4 

3365 

3436 

3507 

3577 

3646 

3716 

1.5 

4055 

4121 

4187 

4253 

4318 

4383 

1.6 

4700 

4762 

4824 

4886 

4947 

5008 

1.7 

5306 

5365 

5423 

5481 

5539 

5596 

1.8 

5878 

5933 

5988 

6043 

6098 

6152 

1.9 

6419 

6471 

6523 

6575 

6627 

6678 

2.0 

0.6931 

6981 

7031 

7080 

7129 

7178 

2,1 

7419 

7467 

7514 

7561 

7608 

76SS 

2.2 

7885 

7930 

7975 

8020 

8065 

8109 

2.3 

8329 

8372 

8416 

8459 

8502 

8544 

2.4 

8755 

8796 

8838 

8879 

8920 

8961 

2.5 

9163 

9203 

9243 

9282 

9322 

9361 

2.6 

9555 

9594 

9632 

9670 

9708 

9746 

2.7 

0.9933 

9969/0006 

0043 

0080 

0116 

Z8 

1.0296 

0332 

0367 

0403 

0438 

0473 

2.9 

0647 

0682 

0716 

0750 

0784 

0818 

3.0 

1.0986 

1019 1053 

1086 

1119 

1151 

3.1 

1314 

1346 

1378 

1410 

1442 

1474 

3.2 

1632 

1663 

1694 

1725 

1756 

1787 

3.3 

1939 

1969 

2000 

2030 2060 

2090 

3.4 

2238 

2267 

2296 

2326 

2355 

2384 

3.5 

2528 

2556 

2585 

2613 

2641 

2669 

3.6 

2809 

2837 

2865 

2892 

2920 

2947 

3.7 

3083 

3110 

3137 

3164 

3191 

3218 

3.8 

3350 

3376 

3403 

3429 

3455 

3481 

3.9 

3610 

3635 3661 

3686 

3712 

3737 

4,0 

1.3863 

3888 

3913 

3938 

3962 

3987 

4.1 

4110 

4134 4159 

4183 

4207 

4231 

4.2 

4351 

4375 

4398 

4422 

4446 

4469 

4.3 

4586 

4609 

4633 

4656 

4679 

4702 

4.4 

4816 

4839 

4861 

4884 

4907 

4929 

4.5 

5041 

5063 

5085 

5107 

5129 

5151 

4.6 

5261 

5282 

5304 

5326 

5347 

5369 

4.7 

5476 

5497 5518 

5539 

5560 

5581 

4.8 

5686 

5707 5728 

5748 

5769 

5790 

4.9 

5892 

5913 

5933 

5953 

5974 

5994 


Tenths of the 
Tabular Difference 

6 7 8 9 10 12345 


0583 

0677 

0770 

0862 

0.0953 

10 19 29 38 48 

1484 

1570 

1655 

1740 

1823 

9 17 28 35 44 

2311 

2390 

2469 

2546 

2624 

8 16 24 32 40 

3075 

3148 

3221 

3293 

3365 

7 15 22 30 37 

3784 

3853 

3920 

3988 

4055 

7 14 21 28 34 

4447 

4511 

4574 

4637 

4700 

6 13 19 26 32 

5068 

5128 

5188 

5247 

5306 

6 12 18 24 30 

5653 

5710 

5766 

5822 

5878 

6 11 17 23 29 

6206 

6259 

6313 

6366 

6419 

5 11 16 22 27 

6729 

6780 

6831 

6881 

0.6931 

5 10 15 2126 

7227 

7275 

7324 

7372 

7419 

5 10 IS 20 24 

7701 

7747 

7793 

7839 

7885 

5 

9 14 19 23 

8154 

8198 

8242 

8286 

8329 

4 

9 13 18 22 

8587 

8629 

8671 

8713 

8755 

4 

9 13 17 21 

9002 

9042 

9083 

9123 

9163 

4 

8 12 16 20 

9400 

9439 

9478 

9517 

9555 

4 

8 1216 20 

9783 

9821^ 

,9858 

9895 

0.9933 

4 

8 11 15 19 

0152 

0188 

0225 

0260 

1.0296 

4 

711 1518 

0508 

0543 

0578 

0613 

0647 

4 

7 111418 

0852 

0886 

0919 

0953 

1.0986 

3 

7 10 14 17 

1184 

1217 

1249 1282 

1314 

3 

7 10 13 16 

1506 

1537 

1569 

1600 

1632 

3 

6 10 13 16 

1817 

1848 

1878 

1909 

1939 

3 

6 9 1215 

2119 

2149 

2179 

2208 

2238 

3 

6 91215 

2413 

2442 

2470 

2499 

2528 

3 

6 91214 

2698 

2726 

2754 

2782 

2809 

3 

6 81114 

2975 

3002 

3029 

3056 

3083 

3 

5 8X114 

3244 

3271 

3297 

3324 

3350 

3 

5 81113 

3507 

3533 

3558 

3584 

3610 

3 

5 81013 

3762 

3788 

3813 

3838 

1.3863 

3 

5 81013 

4012 

4036 

4061 

4085 

4110 

2 

5 71012 

4255 

4279 

4303 

4327 

4351 

2 

5 71012 

4493 

4516 

4540 

4563 

4586 

2 

5 7 912 

4725 

4748 

4770 

4793 

4816 

2 

5 7 911 

4951 

4974 

4996 

5019 

5041 

2 

4 7 911 

5173 

5X95 

5217 

5239 

5261 

2 

4 7 911 

5390 

5412 

5433 

5454 

5476 

2 

4 6 9 U 

5602 

5623 

5644 

5665 

5686 

2 

4 6 SIX 

5810 

5831 

5851 

5872 

5892 

2 

4 6 810 

6014 

6034 

6054 

6074 

1.6094 

2 

4 6 810 
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TABLE X 

LoGe (Base e = 2.718284) 


Ttstteoroe 



0 

1 

2 

3 

4 

5 

6 

7 

S 

9 

10 

Tabula 

1 2 3 4 5 

5.0 

1.6094 

6114 

6134 

6154 

6174 

6194 

6214 

6233 

6253 

6273 

6292 

2 

4 

6 

810 

5.1 

6292 

6312 

6332 

6351 

6371 

6390 

6409 

6429 

6448 

6467 

6487 

2 

4 

6 

810 

5.2 

6487 

6506 

6525 

6544 

6563 

6582 

6601 

6620 

6639 

6658 

6677 

2 

4 

6 

810 

5.3 

6677 

6696 

6715 

6734 

6752 

6771 

6790 

6808 

6827 

6345 

6864 

2 

4 

6 

7 

9 

5.4 

6864 

6832 

6901 

6919 

6938 

6956 

6974 

6993 

7011 

7029 

7047 

2 

4 

6 

7 

9 

S.S 

7047 

7066 

7084 

7102 

7120 

7138 

7156 

7174 

7192 

7210 

7228 

2 

4 

5 

7 

9 

5.6 

7228 

7246 

7263 

7281 

7299 

7317 

7334 

7352 

7370 

7387 

7405 

2 

4 

5 

7 

9 

S.7 

7405 

7422 

7440 

7457 

7475 

7492 

7509 

7527 

7544 

7561 

7579 

2 

3 

5 

7 

9 

5.8 

7579 

7596 

7613 

7630 

7647 

7664 

7681 

7699 

7716 

7733 

7750 

2 

3 

5 

7 

9 

5.9 

7750 

7766 

7783 

7800 

7817 

7834 

7851 

7867 

7884 

7901 

1.7918 

2 

3 

5 

7 

8 

6-0 

1.7918 

7934 

7951 

7967 

7984 

8001 

8017 

8034 

8050 

8066 

8083 

2 

3 

S 

7 

8 

6.1 

8083 

8099 

8116 

8132 

8148 

8165 

8181 

8197 

8213 

8229 

8245 

2 

3 

5 

7 

8 

6.2 

8245 

8262 

8278 

8294 

8310 

8326 

8342 

8358 

8374 

8390 

8405 

2 

3 

S 

6 

8 

6.3 

8405 

8421 

8437 

8453 

8469 

8485 

8500 

8516 

8532 

8547 

8563 

2 

3 

5 

6 

8 

6.4 

8563 

8579 

8594 

8610 

8625 

8641 

8656 

8672 

8687 

8703 

8718 

2 

3 

S 

6 

8 

6.S 

8718 

8733 

8749 

8764 

8779 

8795 

8810 

8825 

8840 

8856 

8871 

2 

3 

5 

6 

8 

6.6 

8871 

8886 

8901 

8916 

8931 

8946 

8961 

8976 

8991 

9006 

9021 

2 

3 

5 

6 

8 

6.7 

9021 

9036 

9051 

9066 

9081 

9095 

9110 

9125 

9140 

9155 

9160 

1 

3 

4 

6 

7 

6.8 

9169 

9184 

9199 

9213 

9228 

9242 

9257 

9272 

9286 

9301 

9315 

1 

3 

4 

6 

7 

6.9 

9315 

9330 

9344 

9359 

9373 

9387 

9402 

9416 

9430 

9445 

1.9459 

1 

3 

4 

6 

7 

7.0 

1,9459 

9473 

9488 

9502 

9516 

9530 

9544 9559 

9573 

9587 

9601 

1 

3 

4 

6 

7 

7.1 

9601 

9615 

9629 

9643 

9657 

9671 

9685 

9699 

9713 

9727 

9741 

1 

3 

4 

6 

7 

7.2 

9741 

9755 

9769 

9782 

9796 

9810 

9824 

9838 

9851 

9865 

1.9879 

1 

3 

4 

6 

7 

7.3 

1.9879 

9892 

9906 

9920 

9933 

9947 

9961 

9974 

9988/obOl 2.0015 

1 

3 

4 

5 

7 

7.4 

2.0015 

0028 

0042 

0055 

0069 

0082 

0096 

0109 

0122 

0136 

0149 

1 

3 

4 

5 

7 

7.5 

0149 

0162 

0176 

0189 

0202 

0215 

0229 

0242 

0255 

0268 

0281 

1 

3 

4 

5 

7 

7.6 

0281 

0295 

0308 

0321 

0334 

0347 

0360 

0373 

0386 

0399 

0412 

1 

3 

4 

5 

7 

7.7 

0412 

0425 

0438 

0451 

0464 

0477 

0490 

0503 

0516 

0528 

0541 

1 

3 

4 

5 

6 

7.8 

0541 

0554 

0567 

0580 

0592 

0605 

0618 

0631 

0643 

0656 

0669 

1 

3 

4 

5 

6 

7.9 

0669 

0681 

0694 

0707 

0719 

0732 

0744 

0757 

0769 

0782 

2.0794 

1 

3 

4 

5 

6 

8,0 

2.0794 

0807 

0819 

0832 

0844 

0857 

0869 

0882 

0894 

0906 

0919 

1 

2 

4 

5 

6 

8.1 

0919 

0931 

0943 

0956 

0968 

0980 

0992 

1005 

1017 

1029 

1041 

1 

2 

4 

5 

6 

8.2 

1041 

1054 

1066 

1078 

1090 

1102 

1114 

1126 

1138 

1150 

1163 

1 

2 

4 

5 

6 

8.3 

1163 

1175 

1187 

1199 

1211 

1223 

1235 

1247 

1258 

1270 

1282 

1 

2 

4 

5 

6 

8.4. 

1282 

1294 

1306 

1318 

1330 

1342 

1353 

1365 

1377 

1389 

1401 

1 

2 

4 

5 

6 

8.5 

1401 

1412 

1424 

1436 

1448 

1459 

1471 

1483 

1494 

1506 

1518 

1 

2 

4 

5 

6 

8.6 

1518 

1529 

1541 

1552 

1564 

1576 

1587 

1599 

1610 

1622 

1633 

1 

2 

3 

5 

6 

8.7 

1633 

1645 

1656 

1668 

1679 

1691 

1702 

1713 

1725 

1736 

1748 

1 

2 

3 

5 

6 

8.8 

1748 

1759 

1770 

1782 

1793 

1804 

1815 

1827 

1838 

1849 

1861 

1 

2 

3 

S 

6 

8.9 

1861 

1872 

1883 

1894 

1905 

1917 

1928 

1939 

1950 

1961 

2.1972 

1 

2 

3 

4 

6 

9.0 

2.1972 

1983 

1994 

2006 

2017 

2028 

2039 

2050 

2061 

2072 

2083 

1 

2 

3 

4 

6 

9.1 

2083 . 

2094 

2105 

2116 

2127 

2138 

2148 

2159 

2170 

2181 

2192 

1 

2 

3 

4 

5 

9.2 

2192 

2203 

2214 

2225 

2235 

2246 

2257 

2268 

2279 

2289 

2300 

I 

2 

3 

4 

5 

9.3 

2300 

2311 

2322 

2332 

2343 

2354 

2364 

2375 

2386 

2396 

2407 

1 

2 

3 

4 

5 

9.4 

2407 

2418 

2428 

2439 

2450 

2460 

2471 

2481 

2492 

2502 

2513 

1 

2 

3 

4 

5 

9.5 

2513 

2523 

2534 

2544 

2555 

2565 

2576 

2586 

2597 

2607 

2618 

1 

2 

3 

4 

5 

9.6 

2618 

2628 

2638 

2649 

2659 

2670 

2680 

2690 

2701 

2711 

2721 

1 

2 

3 

4 

S 

9.7 

2721 

2732 

2742 

2752 

2762 

2773 

2783 

2793 

2803 

2814 

2824 

1 

2 

3 

4 

S 

9.8 

2824 

2834 

2844 

2854 

2865 

2875 

2885 

2895 

2905 

2915 

2925 

1 

2 

3 

4 

s 

9.9 

2925 

2935 

2946 

2956 

2966 

2976 

2986 2996 

3006 

3016 2.3026 

1 

2 

3 

4 

5 
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APPENDIX 2 


TABLE XI 

Logarithms to the Base 10 




1 

2 

3 

4r 

5 

6 

7 

S 

9 

10 

1*00 

0.0000 

0004 

0009 

0013 

0017 . 

0022 

0026 

0030 

0035 

0039 

0043 

1.01 

0043 

0048 

0052 

0056 

0060 

0065 

0069 

0073 

0077 

0082 

0086 

1.02 

0086 

0090 

0095 

0099 

0103 

0107 

0111 

0116 

0120 

0124 

0128 

1.03 

0128 

0133 

0137 

0141 

0145 

0149 

0154 

0158 

0162 

0166 

0170 

1.04 

0170 

0175 

0179 

0183 

0187 

0191 

0195 

0199 

0204 

0208 

0212 

1.05 

0212 

0216 

0220 

0224 

0228 

0233 

0237 

0241 

0245 

0249 

0253 

1.06 

0253 

0257 

0261 

0265 

0269 

0273 

0278 

0282 

0286 

0290 

0294 

1.07 

0294 

0298 

0302 

0306 

0310 

0314 

0318 

0322 

0326 

0330 

0334 

1.08 

0334 

* 0338 

0342 

0346 

0350 

0354 

0358 

0362 

0366 

0370 

0374 

1.09 

0374 

0378 

0382 

0386 

0390 

0394 

0398 

0402 

0406 

0410 

0414 

1.10 

0.0414 

0418 

0422 

0426 

0430 

0434 

0438 

0441 

,0445 

0449 

0453 

1.11 

0453 

0457 

0461 

0465 

0469 

0473 

0477 

0481 

0484 

0488 

0492 

1.12 

0492 

0496 

0500 

0504 

0508 

0512 

0515 

0519 

0523 

0527 

0531 

1.13 

0531 

0535 

0538 

0542 

0546 

0550 

0554 

0558 

0561 

0565 

0569 

1.14 

0569 

0573 

0577 

0580 

0584 

0588 

0592 

0596 

0599 

0603 

0607 

1.15 

0607 

0611 

0615 

0618 

0622 

0626 

0630 

0633 

0637 

0641 

0645 

1.16 

0645 

0648 

0652 

0656 

0660 

0663 

0667 

0671 

0674 

0678 

0682 

1.17 

0682 

0686 

0689 

0693 

0697 

0700 

0704 

0708 

0711 

0715 

0719 

1.18 

0719 

0722 

0726 

0730 

0734 

0737 

0741 

0745 

0748 

0752 

0755 

1.19 

0755 

0759 

0763 

0766 

0770 

0774 

0777 

0781 

0785 

0788 

0792 

1.20 

0.0792 

0795 

0799 

0803 

0806 

0810 

0813 

0817 

0821 

0824 

0828 

1.21 

0828 

0831 

0835 

0839 

0842 

0846 

0849 

0853 

0856 

0860 

0864 

1,'22 

0864 

0867 

0871 

0874 

0878 

0881 

0885 

0888 

0892 

0896 

0899 

1.23 

0899 

0903 

0906 

0910 

0913 

0917 

0920 

0924 

0927 

0931 

0934 

1.24 

0934 

0938 

0941 

0945 

0948 

0952 

0955 

0959 

0962 

0966 

0969 

1.25 

0969 

0973 

0976 

0980 

0983 

0986 

0990 

0993 

0997 

1000 

1004 

1.26 

1004 

1007 

1011 

1014 

1017 

1021 

1024 

1028 

1031 

1035 

1038 

1.27 

1038 

1041 

1045 

1048 

1052 

1055 

1059 

1062 

1065 

1069 

1072 

1.28 

1072 

1075 

1079 

1082 

1086 

1089 

1092 

1096 

1099 

1103 

1106 

1.29 

1106 

1109 

1113 

1116 

1119 

1123 

1126 

1129 

1133 

1136 

1139 

1.30 

0.1139 

1143 

1146 

1149 

1153 

1156 

1159 

1163 

1166 1169 

1173 

1.31 

1173 

1176 

1179 

1183 

1186 

1189 

1193 

1196 

1199 ■ 

1202 

1206 

1.32 

1206 

1209 

1212 

1216 

1219 

1222 

1225 

1229 

1232 

1235 

1239 

1.33 

1239 

1242 

1245 

1248 

1252 

1255 

1258 

1261 

1265 

1268 

1271 

1.34 

1271 

1274 

1278 

1281 

1284 

.1287 

1290 

1294 

1297 

1300 

1303 

1.35 

1303 

1307 

1310 

1313 

1316 

1319 

1323 

1326 

1329 

1332 

1335 

1.36 

1335 

1339 

1342 

1345 

1348 

1351 

1355 

1358 

1361 

1364 

1367 

1.37 

1367 

1370 

1374 

1377 

1380 

1383 

1386 

1389 

1392 

1396 

1399 

1.38 

1399 

1402 

1405 

1408 

1411 

1414 

1418 

1421 

1424 

1427 

1430 

1.39 

1430 

1433 

1436 

1440 

1443 

1446 

1449 

1452 

1455 

1458 

1461 

1.40 

0.1461 

1464 

1467 

1471 

1474 

1477 

1480 

1483 

1486 

1489 

1492 

1.41 

1492 

1495 

1498 

1501 

1504 

1508 

1511 

1514 

1517 

1520 

1523 

1.42 

1523 

1526 

1529 

1532 

1535 

1538 

1541 

1544 

1547 

1550 

1553 

1.43 

1553 

1556 

1559 

1562 

1565 

1569 

1572 

1575 

1578 

1581 

1584 

1.44 

1584 

1587 

1590 

1593 

1596 

1599 

1602 

1605 

1608 

1611 

1614 

1.45 

1614 

1617 

1620 

1623 

1626 

1629 

1632 . 

1635 

1638 

1641 

1644 

1.46 

1644 

1647 

1649 

1652 

1655 

1658 

1661 

1664 

1667 

1670 

1673 

1.47 

1673 

1676 

1679 

1682 

1685 

1688 

1691 

1694 

1697 

1700 

1703 

1,48 

1703 

1706 

1708 

1711 

1714 

1717 

1720 

1723 

1726 

1729 

1732 

1.49 

1732 

1735 

1738 

1741 

1744 

1746 

1749 

1752 

1755 

1758 

1761 
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TABLE XI 

Logabithms to the Base 10 





2 

3 

4 : 


e 

7 

8 

9 

10 

1.50 

0.1761 

1764 

1767 

1770 

1772 

1775 

1778 

1781 

1784 

1787 

1790 

1.51 

1790 

1793 

1796 

1798 

1801 

1804 

1807 

1810 

1813 

1816 

1818 

1.52 

1818 

1821 

1824 

1827 

1830 

1833 

1836 

1838 

1841 

1844 

2847 

1.53 

1847 

1850 

1853 

1855 

1858 

1861 

1864 

1867 

1870 

1872 

1875 

1.54 

1875 

1878 

1881 

1884 

1886 

1889 

1892 

1895 

1898 

1901 

1903 

1.55 

1903 

1906 

1909 

1912 

1915 

1917 

1920 

1923 

1926 

1928 

1931 

1.56 

1931 

1934 

1937 

1940 

1942 

1945 

1948 

1951 

1953 

1956 

1959 

1.57 

1959 

1962 

1965 

1967 

1970 

1973 

1976 

1978 

1981 

1984 

1987 

1.58 

1987 

1989 

1992 

1995 

1998 

2000 

2003 

2006 

2009 

2011 

2014 

1.59 

2014 

2017 

2019 

2022 

2025 

2028 

2030 

2033 

2036 

2038 

2041 

1.00 

0.2041 

2044 

2047 

2049 

2052 

2055 

2057 

2060 

2063 

2066 

2068 

1.61 

2068 

2071 

2074 

2076 

2079 

2082 

2084 

2087 

2090 

2092 

2095 

1.62 

2095 

2098 

2101 

2103 

2106 

2109 

2111 

2114 

2117 

2119 

2122 

1.63 

2122 

2125 

2127 

2130 

2133 

2135 

2138 

2140 

2143 

2146 

2148 

1.64 

2148 

2151 

2154 

2156 

2159 

2162 

2164 

2167 

2170 

2172 

2175 

1.65 

2175 . 

2177 

2180 

2183 

2185 

2188 

2191 

2193 

2196 

2198 

2201 

1.66 

2201 

2204 

2206 

2209 2212 

2214 

2217 

2219 

2222 

2225 

2227 

1.67 

2227 

2230 

2232 

2235 

2238 

2240 

2243 

2245 

2248 

2251 

2253 

1.68 

2253 

2256 

2258 

2261 

2263 

2266 

2269 

2271 

2274 

2276 

2279 

1.69 

2279 

2281 

2284 2287 2289 

2292- 

2294 

,2297 

2299 

2302 

2304 

1.70 

0.2304 

2307 

2310 

2312 2315 

2317 

2320 

2322 

2325 

2327 

2330 

1.71 

2330 

2333 

2335 

2338 

2340 

2343 

2345 

2348 

2350 

2353 

2355 

1.72 

2355 

2358 

2360 

2363 

2365 

2368 

2370 

2373 

2375 

2378 

2380 

1.73 

2380 

2383 

2385 

2388 

2390 

2393 

2395 

2398 

2400 

2403 

2405 

1.74 

2405 

2408 

2410 

2413 

2415 

2418 

2420 

2423 

2425 

2428 

2430 

1.75 

2430 

2433 

2435 

2438 

2440 

2443 

2445 

2448 

2450 

2453 

2455 

1.76 

2455 

2458 

2460 

2463 

2465 

2467 

2470 

2472 

2475 

2477 

2480 

1.77 

2480 

2482 

2485 

2487 

2490 

2492 

2494 

2497 

2499 

2502 

2504 

1.78 

2504 

2507 

2509 

2512 

2514 

2516 

2519 

2521 

2524 

2526 

2529 

1.79 

2529 

2531 

2533 

2536 

2538 

2541 

2543 

2545 

2548 

2550 

2553 

1.80 

0.2553 

2555 

2558 

2560 

2562 

2565 

2567 

2570 

2572 

2574 

2577 

1.81 

2577 

2579 

2582 

2584 

2586 

2589 

2591 

2594 

2596 

2598 

2601 

1.82 

2601 

2603 

2605 

2608 

2610 

2613 

2615 

2617 

2620 

2622 

2625 

1.83 

2625 

2627 

2629 

2632 

2534 

2636 

2639 

2641 

2643 

2646 

2648 

1.84 

2648 

2651 

2653 

2655 

2658 

2660 

2662 

2665 

2667 

2669 

2672 

1.85 

2672 

2674 

2676 

2679 

2681 

2683 

2686 

2688 

2690 

2693 

2695 

1.86 

2695 

2697 

2700 

2702 

2704 

2707 

2709 2711 

2714 

2716 

2718 

1.87 

2718 

2721 

2723 2725 

2728 

2730 

2732 

2735 

2737 

2739 

2742 

1.88 

2742 

2744 

2746 

2749 

2751 

2753 

2755 

2758 

2760 

2762 

2765 

1.89 

2765 

2767 

2769 2772 

2774 

2776 

2778 

2781 2783 

2785 

2788 

1.90 

0J2788 

2790 

2792 

2794 

2797 

2799 

2801 

2804 2806 

2808 

2810 

1.91 

2810 

2813 

2815 

2817 

2819 

2822 

2824 

2826 

2828 

2831 

2833 

1.92 

2833 

2835 

2838 

2840 

2842 

2844 

2847 

2849 

2851 

2853 

2856 

1.93 

2856 

2858 

2860 

2862 

2865 

2867 

2869 

2871 

2874 

2876 

2878 

1.94 

2878 

2880 

2882 

2885 

2887 

2889 


2894 

2896 

2898 

2900 

1.95 

2900 

2903 

2905 

2907 

2909 

29U 

2414 

2916 

2918 

2920 

2923 

1.96 

2923 

2925 

2927 

2929 

2931 

2934 

2936 2938 

2940 

2942 

2945 

1.97 

2945 

2947 

2949 

2951 

2953 

2956 

2958 

2960 2962 

2964 

2967 

1.98 

2967 

2969 

2971 

2973 

2975 

2978 

2980 

2982 

2984 

2986 

2989' 

1.99 

2989 

2991 

2993 2995 

2997 

2999 

3002 3004 ms 

30C^ 

3010 
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APPENDIX 2 


TABLE XI 

Logakithms to the Base 10 


These two pages give the common logarithms of numbers between 1 and 10, correct to four places. 
Moving the rierima! pr:int r. places iz the right (•;? left) in the number is equivalent to adding n (or 
- Ti) to ir- TI.mh. log O.Cl7-li3 - 0.:41ti --2 1= 2.2419]. 

To facilitate interpolation, the tenths of the tabular differences are given at the end of each line, 
so that the differences themselves need not be considered. In using these aids, first find the nearest 
tabular entry, and then add (to move to the right) or subtract (to move to the left), as the case may 
require. 


Tenths of the 
Tabular Difference 



0 

1 

2 

3 

4 


6 

7 

8 

9 

10 

1 

2 

3 

4 

5 

1*0 

0.0000 

0043 

0086 

0128 

0170 

0212 

0253 

0294 

0334 

0374 

0414 






1.1 

0414 

0453 

0492 

0531 

0569 

0607 

0645 

0682 

0719 

0755 

0792 






1.2 

0792 

0828 

0864 

0899 

0934 

0969 

1004 

1038 

1072 

1106 

1139 






13 

1139 

1173 

1206 

1239 

1271 

1303 

1335 

1367 

1399 

1430 

1461 


To avoid Interpo* 

14 

1461 

1492 

1523 

1553 

1584 

1614 

1644 

1673 

1703 

1732 

1761 

lation in the first 
ten lines, use the 

1.5 

1761 

1790 

1818 

1847 

1875 

1903 

1931 

1959 

1987 

2014 

2041 

special table on the 

16 

2041 

2068 

2095 

2122 

2148 

2175 

2201 

2227 

2253 

2279 

2304 

preceding page. 

1.7 

2304 

2330 2355 

2380 

2405 

2430 

2455 

2480 

2504 

2529 

2553 






18 

2553 

2577 

2601 

2625 

2648 

2672 

2695 

2718 

2742 

2765 

2788 






19 

2788 

2810 2833 2856 

2878 

2900 

2923 

2945 

2967 2989 

3010 






2.0 

0.3010 

3032 

3054 3075 

3096 

3118 

3139 

3160 

3181 

3201 

3222 

2 

4 

6 

811 

2.1 

3222 

3243 

3263 

3284 

3304 

3324 

3345 

3365 

3385 

3404 

3424 

2 

4 

6 

810 

2.2 

3424 

3444 

3464 

3483 

3502 

3522 

3541 

356-0 

3579 

3598 

3617 

2 

4 

6 

•8 10 

2.3 

3617 

3636 

3655 

3674 

3692 

3711 

3729 

3747 

3766 

3784 

3802 

2 

4 

5 

7 

9 

2.4 

3802 

3820 

3838 

3856 

3874 

3892 

3909 

3927 

3945 

3962 

3979 

2 

4 

S 

7 

9 

2.5 

3979 

3997 

4014 

4031 

4048 

4065 

4082 

4099 

4116 4133 

4150 

2 

3 

5 

7 

9 

2.6 

4150 

4166 

4183 

4200 

4216 

4232 

4249 

4265 

4281 

4298 

4314 

2 

3 

S 

7 

8 

2.7 

4314 

4330 

4346 

4362 

4378 

4393 

4409 

4425 

4440 

4456 

4472 

2 

3 

5 

6 

8 

2.8 

4472 

4487 

4502 

4518 

4533 

4548 

4564 

4579 

4594 4609 

4624 

2 

3 

5 

6 

8 

2.9 

4624 

4639 

4654 4669 

4683 

4698 

4713 

4728 

4742 

4757 

4771 

1 

3 

4 

6 

7 

3.0 

0.4771 

4786 

4800 4814 4829 

4843 

4857 4871 

4886 

4900 

4914 

1 

3 

4 

6 

7 

3.1 

4914 

4928 

4942 4955 

4969 

4983 

4997 

5011 

5024 

5038 

5051 

1 

3 

4 

6 

7 

3.2 

5051 

5065 

5079 5092 

5105 

5119 

5132 

5145 

5159 ^172 

5185 

1 

3 

4 

5 

7 

3.3 

5185 

5198 

5211 

5224 

5237 

5250 

5263 

5276 

5289 

5302 

5315 

1 

3 

4 

5 

6 

3.4 

5315 

5328 

5340 

5353 

5366 

5378 

5391 

5403 

5416 

5428 

5441 

1 

3 

4 

5 

6 

3.5 

5441 

5453 

5465 

5478 

5490 

5502 

5514 5527 

5539 

5551 

5563 

1 

2 

4 

5 

6 

3.6 

SS63 

5575 

5587 5599 

5611 

5623 

5635 

5647 

5658 

5670 

5682 

1 

2 

4 

5 

6 

3;7 

5682 

5694 

5705 

5717 

5729 

5740 

5752 

*5763 

5775 

5786 

5798 

1 

2 

3 

5 

6 

3.8 

5798 

5809 

5821 

5832 

5843 

5855 

5866 

5877 

5888 

5899 

5911 

1 

2 

3 

5 

6 

3.9 

5911 

5922 

5933 

5944 

5955 

5966 

5977 

5988 

5999 

6010 

6021 

1 

2 

3 

4 

6 

4.0 

0.6021 

6031 

6042 

6053 

6064 

6075 

6085 

6096 

6107 

6117 

6128 

1 

2 

3 

4 

5 

4.1 

6128 

6138 

6149 

6160 

6170 

6180 

6191 

6201 

6212 

6222 

6232 

1 

2 

3 

4 

5 

4.2 

6232 

6243 

6253 

6263 

6274 

6284 

6294 

6304 

6314 

6325 

6335 

1 

2 

3 

4 

5 

4.3 

6335 

6345 

6355 

6365 

6375 

6385 

6395 

6405 

6415 

6425 

6435 

1 

2 

3 

4 

5 

4.4 

6435 

6444 

6454 6464 

6474 

6484 

6493 

6503 

6513 

6522 

6532 

1 

2 

3 

4 

5 

4.S 

6532 

6542 

6551 

6561 

6571 

6580 

6590 

6599 6609 

6618 

6628 

1 

2 

3 

4 

S 

4.6 

6628 

6637 

6646 6656 

6665 

6675 

6684 

6693 

6702 

6712 

6721 

1 

2 

3 

4 

5 

4.7 

6721 

6730 

6739 

6749 

6758 

6767 

6776 

6785 

6794 

6803 

6812 

1 

2 

3 

4 

5 

4.8 

6812 

6821 

6830 

6839 

6848 

6857 

6866 

6875 

6884 

6893 

6902 

1 

2 

3 

4 

4 

4.9 

6902 

6911 

6920 6928 

6937 

6946 

6955 

6964 

6972 

6981 

6990 

1 

2 

3 

4 

4 
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TABLE XI 

Logaeithms to the Base 10 


Tenths of tbft 


5.0 

0 

1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

lamuar uinerm 
1 2 3 4 5 

0.6990 

6998 

7007 

7016 

7024 

7033 

7042 

7050 

7059 

7067 

7076 

1 

2 

3 

3 

4 

5.1 

7076 

7084 

7093 

7101 

7110 

7118 

7126 

7135 

7143 

7152 

7160 

1 

2 

3 

3 

4 

5.2 

7160 

7168 

7177 

7185 

7193 

7202 

7210 

7218 

7226 7235 

7243 

1 

2 

2 

3 

4 

5.3 

7243 

7251 

7259 

7267 

7275 

7284 

7292 

7300 

7308 7316 

7324 

1 

2 

2 

3 

4 

5.4 

7324 

7332 

7340 

7348 

7356 

7364 

7372 

7380 

7388 7396 

7404 

1 

2 

2 

3 

4 

5.5 

7404' 

7412 

7419 

7427 

7435 

7443 

7451 

7459 

7466 7474 

7482 

.1 

2 

2 

3 

4 

5.6 

7482 

7490 

7497 

7505 

7513 

7520 

7528 

7536 

7543 

7551 

7559 

1 

2 

2 

3 

4 

5.7 

7559 

7566 

7574 

7582 

7589 

7597 

7604 

7612 

7619 

7627 

7634 

1 

2 

2 

3 

4 

5.8 

7634 

7642 

7649 

7657 

7664 

7672 

7679 

7686 

7694 7701 

7709 

1 

1 

2 

3 

4 

5.9 

7709 

7716 

7723 

7731 

7738 

7745 

7752 

7760 

7767 

7774 

7782 

1 

1 

2 

3 

4 

6.0 

0.7782 

7789 

7796 

7803 

7810 

7818 

7825 

7832 

7839 

7846 

7853 

1 

1 

2 

3 

4 

6.1 

7853 

7860 

7868 

7875 

7882 

7889 

7896 

7903 

7910 

7917 

7924 

1 

1 

2 

3 

4 

6.2 

7924 

7931 

7938 

7945 

7952 

7959 

7966 

7973 

7980 

7987 

7993 

1 

1 

2 

3 

3 

6.3 

7993 

8000 

8007 

8014 

8021 

8028 

8035 

8041 

8048 

8055 

8062 

1 

1 

2 

3 

3 

6.4 

8062 

8069 

8075 

8082 

8089 

8096 

8102 

8109 

8116 

8122 

8129 

I 

1 

2 

3 

3 

6.5 

8129 

8136 

8142 

8149 

8156 

8162 

8169 

8176 

8182 8189 

8195 

1 

1 

2 

3 

3 

6.6 

8195 

8202 

8209 

8215 

8222 

8228 

8235 

8241 

8248 

8254 

8261 

1 

1 

2 

3 

3 

6.7 

8261 

8267 

8274 

8280 

8287 

8293 

8299 

8306 

8312 

8319 

8325 

1 

1 

2 

3 

3 

6.8 

8325 

8331 

8338 

8344 

8351 

8357 

8363 

8370 

8376 

8382 

8388 

1 

1 

2 

3 

3 

6,9 

8383 

8395 

8401 

8407 

8414 

8420 

8426 

8432 

8439 

8445 

8451 

1 

I 

2 

3 

3 

7.0 

0.8451 

8457 

8463 

8470 

8476 

8482 

8488 

8494 

8500 

8506 

8513 

1 

1 

2 

2 

3 

7,1 

8513 

8519 

8525 

8531 

8537 

8543 

8549 

8555 

8561 

8567 

8573 

1 

1 

2 

2 

3 

7,2 

8573 

8579 

8585 

8591 

8597 

8603 

8609 

8615 

8621 

8627 

8633 

1 

1 

2 

2 

3 

7.3 

8633 

8639 

8645 

8651 

8657 

8663 

8669 

8675 

8681 

8686 

8692 

1 

1 

2 

2 

3 

7.4 

8692 

8698 

8704 

8710 

8716 

8722 

8727 

8733 

8739 8745 

8751 

1 

1 

2 

2 

3 

7.5 

8751 

8756 

8762 

8768 

8774 

8779 

8785 

8791 

8797 

8802 

8808 

1 

1 

2 

2 

3 

7.6 

8808 

8814 

8820 

8825 

8831 

8837 

8842 

8848 

8854 

8859 

8865 

1 

1 

2 

2 

3 

7.7 

8865 

8871 

8876 

8882 

8887 

8893 

8899 

8904 

8910 8915 

8921 

1 

1 

2 

2 

3 

7.8 

8921 

8927 

8932 

8938 

8943 

8949 

8954 

8960 

8965 

8971 

8976 

1 

1 

2 

2 

3 

7.9 

8976 

8982 

8987 

8993 

8998 

9004 

9009 

9015 

9020 9025 

9031 

1 

1 

2 

2 

3 

8.0 

•0.9031 

9036 

9042 

9047 

9053 

9058 

9063 

9069 

9074 9079 

9085 

1 

1 

2 

2 

3 

8.1 

9085 

9090 

9096 

9101 

9106 

9112 

9117 

9122 

9128 

9133 

9138 

1 

1 

2 

2 

3 

8.2 

9138 

9143 

9149 

9154 

9159 

9166 

9170 

9175 

9180 9186 

9191 

1 

1 

2 

2 

3 

8.3 

9191 

9196 

9201 

9206 

9212 

9217 

9222 

9227 

9232 

9238 

9243 

1 

1 

2 

2 

3 

8.4 

9243 

9248 

9253 

9258 

9263 

9269 

9274 

9279 

9284 

9289 

9294 

1 

1 

2 

2 

3 

8.5 

9294 

9299 

9304 

9309 

9315 

9320 

9325 

9330 

9335 

9340 

9345 

1 

1 

2 

2 

3 

8.6 

9345 

9350 

9355 

9360 

9365 

9370 

9375 

9380 

9385 

9390 

9395 

1 

1 

2 

2 

3 

8.7 

9395 

9400 

9405 

9410 

9415 

9420 

9425 

9430 

9435 9440 

9445 

0 

1 

1 

2 

2 

8.8 

9445 

9450 

9455 

9460 

9465 

9469 

9474 

9479 

9484 

9489 

9494 

0 

1 

1 

2 

2 

8.9 

9494 

9499 

9504 

9509 

9513 

9518 

9523 

9528 

.9533 

9538 

9542 

0 

1 

1 

2 

2 

9.0 

0.9542 

9547 

9552 

9557 

9562 

9566 

9571 

9576 

9581 

9586 

9590 

0 

1 

1 

2 

2 

9.1 

9590 

9595 

9600 

9605 

9609 

9614 

9619 

9624 

9628 

9633 

9638 

0 

1 

1 

2 

2 

9.2 

9638 

9643 

9647 

9652 

9657 

9661 

9666 

9671 

9675 

9680 

9685 

0 

1 

1 

2 

2 

9.3 

9685 

9689 

9694 

9699 

9703 

9708 

9713 

9717 

9722 

9727 

9731 

0 

1 

1 

2 

2 

9.4 

9731 

9736 

9741 

9745 

9750 

9754 

9759 

9763 

9768 9773 

9777 

0 

i 

1 

2 

2 

9.5 

9777 

9782 

9786 

9791 

9795 

9800 

9805 

9809 

9814 

9813 

9823 

0 

1 

1 

2 

■ 2 

9.6 

9823 

9827 

9832 

9836 

9841 

9845 

9850 

9854 

9859 9863 

9868 

0 

1 

1 

2 

2 

9.7 

9868 

9872 

9877 

9881 

9886 

9890 

9894 

9m 

9903 9908 

9912 

0 

1 

1 

2 

2 

9.8 

9912 

9917 

9921 

9926 

9930 

9934 

9939 

9943 

9948 

9952 

9956 

0 

1 

1 

2 

2 

9.9 

9956 

9961 

9965 

9969 

9974 

9978 

9983 

9987 

9991 9996 


0 

X 

1 

2 

2 
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APPENDIX 2 


TABLE Xn 

Square Boots of Numbers 


A ' 

0 

1 

2 

3 

4 

5 

6 

7 

8 

9 

Avg. 

diff. 

1.0 

1.000 

1.005 

1.010 

1.015 

1.020 

1.025 

1.030 

1.034 

1.039 

1.044 

5 

1 

1,049 

1.054 

1.058 

1.063 

1.068 

1.072 

1.077 

1.082 

1.086 

1.091 


2 

1.095 

1.100 

1.105 

1.109 

1.114 

1.118 

1.122 

1.127 

1.131 

1.136 

4 

3 

1.140 

1.145 

1.149 

1.153 

1.158 

1.162 

1.166 

1.170 

1.175 

1.179 


4 

1.183 

1.187 

1.192 

1.L96 

1.200 

1.204 

1.208 

1.212 

1.217 

1.221 


1.5 

1.225 

1.229 

1.233 

1.237 

1.241 

1.245 

1.249 

1.253 

1.257 

1.261 


6 

1.265 

1.269 

1.273 

1.277 

1.281 

1.285 

1.288 

1.292 

1.296 

1.300 


7 

1.304 

1.308 

1.311 

1.315 

1.319 

1.323 

1.327 

1.330 

1.334 

1.338 


8 

1.342 

1.345 

1.349 

1.353 

1.356 

1.360 

1.364 

■1.367 

1.371 

1.375 


9 

1.378 

1.382 

1.386 

1.389 

1.393 

1.396 

1.400 

1.404 

1.407 

1.411 


2.0 

1.414 

1,418 

1.421 

1.425 

1.428 

1.432 

1.435 

1.439 

1.442 

1.446 


1 

1.449 

1.453 

1.456 

1.459 

1.463 

1.466 

1.470 

1.473 

1.476 

1.480 

3 

2 

1.483 

1.487 

1.490 

1.493 

1.497 

1.500 

1.503 

1.507 

1.510 

1.513 


3 

1.517 

1.520 

1.523 

1.526 

1.530 

1.533 

1.536 

1.539 

1.543 

1.546 


4 

1.549 

1.552 

1.556 

1.559 

1.562 

1.565 

1.568 

1.572 

1.575 

1.578 


2.5 

1.581 

1.584 

1.587 

1.591 

1.594 

1.597 

1.600 

1.603 

1.606 

1.609 


6 

1.612 

1.616 

1.619 

1.622 

1.625 

1.628 

1.631 

1.634 

1.637 

1.640 


7 

1.643 

1.646 

1.649 

1.652 

1.655 

1.658 

1.661 

1.664 

1.667 

1.670 


8 

1.673 

1.676 

1.679 

1.682 

1.685 

1.688 

1.691 

1.694 

1.697 

1.700 


9 

1.703 

1.706 

1.709 

1.712 

1.715 

1.718 

1.720 

1.723 

1.726 

1.729 


3.0 

1.732 

1.735 

1.738 

1.741 

1.744 

1,746 

1.749 

1.752 

1.755 

1.758 


1 

1.761 

1.764 

1,766 

1.769 

1,772 

1-775 

1.778 

1.780 

1.783 

1.786 


2 

1.789 

1.792 

1.794 

1.797 

1.800 

1.803 

1.806 

1.808 

1.811 

1.814 


3 

1.81'7 

1.819 

1.822 

1.825 

1.828 

1.830 

1.833 

1.836 

1.838 

1.841 


4 

1.844 

1.847 

1.849 

1.852 

1.855 

1.857 

1,860 

1.863 

1.865 

1.868 


3.5 

1.871 

1.873 

1.876 

1.879 

1.881 

1.884 

1.887 

1.889 

1.892 

1.895 


6 

1.897 

1.900 

1.903 

1.905 

1.908 

1.910 

1.913 

1.916 

1.918 

1.921 


7 

1.924 

1.926 

1.929 

1.931 

1.934 

1.936 

1.939 

1.942 

1.944 

1.947 


8 

1.949 

1.952 

1.954 

1.957 

1.960 

1.962 

1.965 

1.967 

1.970 

1.972 


9 

1.975 

1.977 

1.980 

1.982 

1.985 

1-987 

1.990 

1.992 

1.995 

1.997 


4.0 

2.000 

2.002 

2.005 

2.007 

2.010 

2-012 

2.015 

2.017 

2.020 

2.022 


1 

2.025 

2.027 

2.030 

2.032 

2.035 

2.037 

2.040 

2.042 

2.045 

2.047 

1 2 

2 

2.049 

2.052 

2.054 

2.057 

2.059 

2.062 

2.064 

2.066 

2.069 

2.071 


3 

2.074 

2.076 

2.078 

2.081 

2.083 

2.086 

2.088 

2.090 

2.093 

2.095 


4 

2.098 

2.100 

2.102 

2.105 

2.107 

2.110 

2.112 

2.114 

2.117 

2.119 


4.5 

2.121 

2.124 

2.126 

2.128 

2.131 

2.133 

2.135 

2.138 

2.140 

2.142 


6 

2.145 

2.147 

2.149 

2.152 

2.154 

2.156 

2.159 

2.161 

2.163 

2.166 


7 

2.168 

2.170 

2.173 

2.175 

2.177 

2.179 

2.182 

2.184 

2-186 

2.189 


8 

2.191 

2.193 

2,195 

2.198 

2.200 

2.202 

2.205 

2.207 

2.209 

2.211 


9 

2.214 

2.216 

2.218 

2-220 

2.223 

2.225 

2.227 

2.229 

2.232 

2.234 



Vx = 1.77245+ 

1/Vx = 

0.56419 

V5F72 

== 1.25331 

■y/e^ 1.64872 


Explanation of Table of Square Roots 

This table gives the values of VA for values of N from 1 to 100, correct to four figures. 
(Interpolated values may be in error by 1 in the fourth figure.) 

To find the square root of a number N outside the range from 1 to 100, divide the 
digits of the number into blocks of two (beginning with the decimal point), and note 
that moving the decimal point two places in iV is equivalent to moving it one place in 
the square root of N. Por example: 

1.648; ^/WLE=UAS; V0-0d02718 = 0.01648; 

* 5,213; V2718" ^ 52.13; V0.002718 = 0.05213. 
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TABLE XII 
Square Roots 


.V 

0 

1 

2 

3 

4 

5 

6 

7 

8 

9 

5.0 

2.236 

2.238 

2.241 

2.243 

2.245 

2.247 

2.249 

2.252 

2.254 

2.256 

1 

2.258 

2.261 

2.263 

2.265 

2.267 

2.269 

2.272 

2.274 

2.276 

2.278 

2 

2.2S0 

2.283 

2.285 

2.287 

2.289 

2.291 

2.293 

2.296 

2.298 

2.300 

3 

2.302 

2.304 

2.307 

2.309 

2.311 

2.313 

2.315 

2.317 

2.319 

2.322 

4 

2.324 

2.326 

2.328 

2.330 

2.332 

2.335 

2.337 

2.339 

2.341 

2.343 

5.5 

2.345 

2.347 

2.349 

2.352 

2.354 

2.356 

2.358 

2.360 

2.362 

2.364 

6 

2.366 

2.369 

2.371 

2.373 

2.375 

2.377 

2.379 

2.381 

2.383 

2.3S5 

7 

2.387 

2.390 

2.392 

2.394 

2.396 

2.398 

2.400 

2.402 

2.404 

2.406 

8 

2.408 

2.410 

2.412 

2.415 

2.417 

2.419 

2.421 

2.423 

2.425 

2.427 

9 

2.429 

2,431 

2.433 

2.435 

2.437 

2.439 

2.441 

2.443 

2.445 

2.447 

6.0 

2.449 

2.452 

2.454 

2.456 

2.458 

2.460 

2.462 

2.464 

2.466 

2.468 

1 

2.470 

2.472 

2.474 

2.476 

2.478 

2.480 

2.482 

2.484 

2.486 

2.488 

2 

2.490 

2.492 

2.494 

2.496 

2.498- 

2.500 

2.502 

2.504 

2.506 

2.508 

3 

2.510 

2.512 

2.514 

2.516 

2.518 

2.520 

2.522 

2.524 

2.526 

2.528 

4 

2.530 

2.532 

2.534 

2.536 

2.538 

2.540 

2.542 

2.544 

2.546 

2.548 

6.5 

2.550 

2.551 

2.553 

2.555 

2.557 

2.559 

2.561 

2.563 

2.565 

2.567 

6 

2.569 

2.571 

2.573 

2.575 

2.577 

2.579 

2.581 

2.583 

2.585 

2.587 

7 

2.588 

2.590 

2.592 

2.594 

2.596 

2.598 

2.600 

2.602 

2.604 

2.606 

8 

2.608 

2.610 

2.612 

2.613 

2.615 

2.617 

2.619 

2.621 

2.623 

2.625 

9 

2.627 

2.629 

2.631 

2.632 

2.634 

2.636 

2.638 

2.640 

2.642 

2.644 

7.0 

2.646 

2.648 

2.650 

2.651 

2.653 

2.655 

2.657 

2.659 

2.661 

2.663 

1 

2.665 

2.666 

2,668 

2.670 

2.672 

2.674 

2.676 

2.678 

2.680 

2.681 

2 

2.683 

2.685 

2.687 

2.689 

2.691 

2.693 

2.694 

2.696 

2.698 

2.700 

3 

2.702 

2.704 

2.706 

2.707 

2.709 

2.711 

2.713 

2.715 

2.717 

2.718 

4 

2.720 

2.722 

2.724 

2.726 

2.728 

2.729 

2.731 

2.733 

2.735 

2.737 

7.5 

2.739 

2.740 

2.742 

2.744 

2.746 

2.748 

2.750 

2.751 

2.753 

2.755 

6 

2.757 

2.759 

2.760 

2.762 

2.764 

2.766 

2.768 

2.769 

2.771 

2.773 

7 

2.775 

2.777 

2.778 

2.780 

2.782 

2.784 

2.786 

2.787 

2.789 

2.791 

8 

2.793 

2.795 

2.796 

2.798 

2.800 

2.802 

2.804 

2.805 

2.807 

2.809 

9 

2.811 

2.812 

2,814 

2.816 

2.818 

2.820 

2.821 

2.823 

2.825 

2.827 

8.0 

2.828 

2.830 

2.832 

2.834 

2.835 

2.837 

2.839 

2.841 

2.843 

2.844 

1 

2.846 

2.848 

2.850 

2.851 

2.853 

2.855 

^.857 

2.858 

2.860 

2.862 

2 

2.864 

2.865 

2.867 

2.869 

2.871 

2.872 

2.874 

2.876 

2.877 

2.879 

3 

2.881 

2.883 

2.884 

2.886 

2.888 

2.890 

2.891 

2.893 

2.895 

2.897 

4 

2.898 

2.900 

2.902 

2.903 

2.905 

2.907 

2.909 

2.910 

2.912 

2.914 

8.5 

2.915 

2.917 

2.919 

2.921 

2.922 

2.924 

2.926 

2.927 

2.929 

2.931 

6 

2.933 

2.934 

2.936 

2.938 

2.939 

2.941 

2.943 

2.944 

2.946 

2.948 

7 1 

2.950 

2.951 

2.953 

2.955 

2.956 

2,958 

2.960 

2,961 

2.963 

2.965 

8 

2.966 

2.968 

2.970 

2.972 

2.973 

2.975 

2.977 

2.978 

2.980 

2.982 

9 

2.983 

2.985 

2.987 

2.988 

2.990 

2.992 

2.993 

2.995 

2.997 

2.998 

9.0 

3.000 

3.002 

3.003 

3.005 

3.007 

3.008 

3.010 

3.012 

3.013 

3.015 

1 

3.017 

3.018 

3.020 

3.022 

3.023 

3.025 

3.027 

3.028 

3.030 

3.032 

2 

3.033 

3.035 

3.036 

3.038 

3.040 

3.041 

3.043 

3.045 

3.046 

3.048 

3 

3.050 

3.051 

3.053 

3.055 

3.056 

3.058 

3.059 

3.061 

3.063 

3.064 

4 

3.066. 

3.068 

3.069 

3.071 

3.072 

3.074 

3.076 

3-077 

3.079 

3.081 

9.5 

3.082 

3.084 

3.085 

3.087 

3.089 

3.090 

3.092 

3.094 

3.095 

3.097 

6 

3.098 

3.100 

3.102- 

3.103 

3-105 

3.106 

3,108 

3.110 

3.111 

3,113 

7 

3.114 

3.116 

3.118 

3.119 

3.121 

3.122 

3.124 

3.126 

3.127 

3.129 

8 

3.130 

3.132 

3.134 

3.135 

3.137 

3.138 

3.140 

3.142 

3.143 

3.145 

9 

3.146 

3.148 

3.150 

3-151 

3.153 

3.154 

3.156 

3.158 

3.159 

3.161 


Moving the decimal point TWO places in N requires moving it ONE place in body 
of table. 
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APPENDIX 2 


TABLE XII 
Squaee Boots 


N 

0 

1 

2 

3 

4 

5 

6 

7 

8 

0 

Avg. 

diff.l 

10. 

3.162 

3.178 

3.194 

3.209 

3.225 

3.240 

3.256 

3.271 

3.286 

3.302 

16 

1. 

3.317 

3.332 

3.347 

3.362 

3.376 

3.391 

3.406 

3.421 

3.436 

3.450 

15 

2. 

3.464 

3.479 

3.493 

3.507 

3.521 

3.536 

3.550 

3.564 

3.578 

3.592 

14 

3. 

3.606 

3.619 

3.633 

3.647 

3.661 

3.674 

3.688 

3.701 

3.715 

3.728 


4. 

3.742 

3.755 

3.768 

3.782 

3.795 

3.808 

3.821 

3.834 

3.847 

3.860 

13 

16. 

3.873 

3.886 

3.899 

3.912 

3.924 

3.937 

3.950 

3.962 

3,975 

3.987 


6. 

4.000 

4.012 

4.025 

4.037 

4.060 

4.062 

4.074 

4.087 

4.099 

4.111 

12 

7. 

4,123 

4.135 

4.147 

4.159 

4.171 

4.183 

4.195 

4.207 

4.219 

4.231 


8. 

4.243 

4.254 

4.266 

4.278 

4.290 

4.301 

4.313 

4.324 

4.336 

4.347 i 


9. 

4.359 

4.370 

4.382 

4.393 

4.405 

4.416 

4.427 

4.438 

4.450 

4.461 

11 

20. 

4.472 

4.483 

4.494 

4.506 

4.517 

4.528 

4.539 

4.550 

4.561 

4.572 


1. 

4.583 

4.593 

4.604 

4.615 

4.626 

4.637 

4.648 

4.658 

4.669 

4.680 


2. 

4.690 

4.701 

4.712 

4.722 

4.733 

4.743 

4.754 

4.764 

4.775 

4.785 



4.796 

4.806 

4.817 

4.827 

4.837 

4.848 

4.858 

4.868 

4.879 

4.889 

10 

4. 

4.899 

4.909 

4,919 

4.930 

4.940 

4.950 

4.960 

4.970 

4.980 

4.990 


25. 

5.000 

5.010 

5.020 

5.030 

5,040 

5.050 

5.060 

5.070 

5.079 

5.089 


6. 

5.099 

5.109 

5.119 

5.128 

5.138 

5.148 

5.158 

5.167 

5.177 

5.187 


7. 

5.196 

5.206 

5,215 

5.225 

5.235 

5.244 

5.254 

5.263 

5.273 

5.282 


8. 

5.292 

5.301 

5.310 

5.320 

5.329 

5.339 

5.348 

5.357 

5.367 

5.376 

9 

9. 

5.385 

5.394 

5,404 

5.413 

5.422 

5.431 

5.441 

5.450 

5,459 

5.468 


30. 

5.477 

5.486 

5.495 

5.505 

5.514 

5.523 

5.532 

5.541 

5.550 

5.559 


1. 

5.568 

5.577 

5.586 

5.595 

5.604 

5.612 

5.621 

5.630 

6.639 

5.648 


2. 

5.657 

5.666 

5.675 

5.683 

6.692 

5.701 

5.710 

5.718 

5.727 

5.736 


3. 

5.745 

5.753 

5,762 

5.771 

5.779 

5.788 

5.797 

5.805 

5.814 

5.822 


4. 

5.831 

5.840 

5.848 

5.857 

5.865 

5.874 

5.882 

5.891 

6.899 

5.908 

8 

35. 

5.916 

5.925 

5.933 

5.941 

5.950 

5.958 

5.967 

5.976 

6.983 

5.992 


6. 

6.000 

6.008 

6.017 

6.025 

6.033 

6.042 

6.050 

6.058 

6.066 

6.075 


7, 

6.083 

6.09-1 

6.099 

6.107 

6.116 

6.124 

6.132 

6.140 

6.148 

6.156 


8. 

6.164 

6.173 

6.181 

6.189 

6.197 

6.205 

6.213 

6.221 

6.229 

6.237 


9. 

6.245 

6.253 

6.261 

6.269 

6.277 

6.285 

6.293 

6.301 

6.309 

6.317 


40. 

6.325 

6.332 

6.340 

6.348 

6.356 

6.364 

6.372 

6.380 

6.387 

6.395 


1. 

6.403 

6.411 

6.419 

6.427 

6.434 

6.442 

6.450 

6.458 

6.465 

6:473 


2. 

6.481 

6.488 

6.496 

6.504 

6.512 

6.519 

6.527 

6.535 

6.542 

6.550 


3. 

6.557 

6.565 

6.573 

6.580 

6.588 

6.595 

6.603 

6.611 

6.618 

6.626 


4. 

6.633 

6.641 

6.648 

6.656 

6.663 

6.671 

6.678 

6.686 

6.693 

6.701 


45. 

6.708 

6.716 

6.723 

6.731 

6.738 

6.745 

6.753 

6,760 

6.768 

6.775 


6. 

6.782 

6.790 

6.797 

6.804 

6.812 

6.819 

6.826 

6.834 

6.841 

6.848 


7. 

6.856 

6.863 

6.870 

6.877 

6.885 

6.892 

6,899 

6.907 

6.914 

6.921 


8. 

6.928 

6.935 

6.943 

6.950 

6.957 

6.964 

6.971 

6.979 

6.986 

6.993 


9. 

7.000 

7.007 

7.014 

7.021 

7.029 

7.036 

7.043 

7.060 

7.057 

7.064 



Square Roots of Certain Fractions 




N 

VN 

N: 

VN 

N 

vw 

iV 

vw 

N 


34 

0.7071 

% 

0.7746 


0.7559 


0.3333 

M2 

0.6455 

He 

0.7500 

34 

0.5774 

H 

0.8944 


0.8452 


0,4714 


0.7638 

me 

0.8292 

H 

0.8165 

H 

0.4082 


0.9258 

ii 1 

0.6667 

1^2 

0.9574 

me 1 

0.9014 

U 

0.5000 

H 

0.9129 

H \ 

0,3536 

H 

0.7454 

He 

0.2500 

me 

0.9682 

n 

0.8660 

34 

0.3780 

H 1 

0.6124 

1 

0.8819 

He 

0.4330 


0.1768 

u 

0.4472 


0.5345 

H I 

0.7906 

H i 

0.9428 

He 

0.5590 

Hi 

0.1250 


0.6325 


0.6547 

% 

0.9354 

M2 

0.2887 . 

He 

0.6614 

1 

Ho 

0,1414 
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TABLE XII 
Square Roots 


-Y 

0 

i 

1 

2 

3 

4 

5 

6 

7 

a 

9 

50. 

1 7-071 

7.078 

7.085 

7.092 

7.099 

7.106 

7.113 

7.120 

7.127 

7.134 

1. 

7.141 

7.148 

7.155 

7.162 

7.169 

7.176 

7.183 

7.190 

7.197 

7.204 , 

2 

i 7.211 

7.218 

7.225 

7.232 

7.239 

7.246 

7.253 

7.259 

7.266 

7.273 ^ 

3. 

1 7.280 

7.287 

7.294 

7.301 

7.308 

7.314 

7.321 

7.328 

7.335 

7.342 

4. 

7.348 

7.355 

7.362 

7.369 

7.376 

7.382 

7.389 

7.396 

7.403 

7.409 

55. 

7.416 

7.423 

7.430 

7.436 

7.443 

7.450 

7.457 

7,463 

7.470 

7.477 ' 

6. 

7-483 

7.490 

7.497 

7.503 

7.510 

7.517 

7.523 

7.530 

7.537 

7.543 

7. 

7.550 

7.556 

7.563 

7.570 

7.576 

7.583 

7.589 

7,596 

7.603 

7.609 i 

8. 

7.616 

7.622 

7.629 

7.635 

7.642 

7.649 

7.655 

7.662 

7.668 

7.675 

9. 

7-681 

7.688 

7.694 

7.701 

7.707 

7.714 

7-720 

7.727 

7.733 

7.740 

60 . 

7.746 

7.752 

7.759 

7.765 

7.772 

7.778 

7.785 

7.791 

7.797 

7.804 

1. 

7.810 

7.817 

7.823 

7.829 

7.836 

7.842 

7. S 49 

7.855 

7.861 

7.868 

2. 

7.874 

7. SS 0 

7.887 

7.893 

7.899 

7.906 

7.912 

7.918 

7.925 

7.931 

3. 

7.937 

7.944 

7.950 

7.956 

7.962 

7.969 

7.975 

7.981 

7.987 

7.994 

4. 

8.000 

8.006 

8.012 

8.019 

8.025 

8.031 

8.037 

8.044 

8.050 

8.056 

65 . 

1 8.062 

8.068 

8.075 

8.081 

8.087 

8.093 

8.099 

8.106 

8.112 

8.118 

6. 

' 8.124 

8.130 

8.136 

8-142 

8.149 

8.155 

8.161 

8.167 

8.173 

8.179 

7. 

8.185 

8.191 

8.198 

8.204 

8.210 

8.216 

8.222 

8.228 

8,234 

8.240 

8. 

8.246 

8.252 

8.258 

8.264 

8.270 

8.276 

8.283 

8.289 

8.295 

8.301 

9. 

8.307 

8.313 

8.319 

8.325 

8.331 

8.337 

8.343 

8.349 

8.355 

8.361 

70 . 

8.367 

8.373 

8.379 

8.385 

8.390 

8.396 

8.402 

8.408 

8.414 

8.420 

1. 

8.426 

8.432 

8.438 

8.444 

8.450 

8.456 

8.462 

8.468 

8.473 

8.479 

2. 

8.485 

8.491 

8.497 

8.503 

8.509 

8.515 

8.521 

8.526 

8.532 

8.538 

3. 

8.544 

8.550 

8.556 

8.562 

8.567 

8.573 

8.579 

8.585 

8.591 

8.597 

4. 

8.602 

8.608 

8.614 

8.620 

8,626 

8.631 

8.637 

8.643 

8.649 

8.654 

75 . 

8.660 

8.666 

8.672 

8.678 

8.683 

8.689 

8.695 

8.701 

8.706 

8.712 

6. 

8.718 

8.724 

8.729 

8.735 

8.741 

8.746 

8.752 

8.758 

8.764 

8.769 

7 : 

8.775 

8.781 

8.786 

8.792 

8.798 

8.803 

8.809 

8.815 

8.820 

8.826 

8 . 

8.832 

8.837 

8,843 

8.849 

8.854 

8.860 

8.866 

8.871 

8.877 

8.883 

9. 

8.888 

8.894 

8,899 

8.905 

8.911 

8.916 

8.922 

8.927 

8.933 

8.939 

80 . 

8.944 

8.950 

8.955 

8.961 

8.967 

8.972 

8.978 

8.983 

8.989 

8.994 1 

1. 

9.000 

9.006 

9.011 

9.017 

9.022 

9.028 

9.033 

9.039 

9.044 

9.050 

2. 

9.055 

9.061 

9.066 

9.072 

9.077 

9.083 

9.088 

9.094 

9.099 

9.105 

3. 

9.110 

9.116 

9.121 

9-127 

9.132 

9.138 

9.143 

9.149 

9.154 

9.160 

4. 

9.165 

9.171 

9.176 

9.182 

9.187 

9.192 

9.198 

9.203 

9.209 

9.214 

85 . 

9.220 

9.225 

9.230 

9.236 

9.241 

9.247 

9.252 

9.257 

9.263 

9.268 

6. 

9.274 

9.279 

9.284 

9.290 

9.295 

9.301 

9.306 

9.311 

9.317 

9.322 

7. 

9.327 

9.333 

9.338 

9.343 

9.349 

9.354 

9.359 

9.365 

9.370 

9.375 

8. 

9.381 

9.386 

9.391 

9.397 

9.402 

9.407 

9.413 

9.418 

9,423 

9.429 

9. 

9.434 

9.439 

9.445 

9.450 

9.455. 

9.460 

9.466 

9.471 

9.476 

9.482 

90 . 

9.487 

9.492 

9.497 

9.503 

9.508 

9.513 

9.518 

9.524 

9.529 

9.534 

1. 

9.539 

9.545 

9.550 

9.555 

9.560 

9.566 

9.571 

9.576 

9.581 

9.586 

2. 

9.592 

9.597 

9.602 

9.607 

9.612 

9.618 

9.623 

9.628 

9.633 

9.638 

3. 

9.644 

9.649 

9.654 

9.659 

9.664 

9.670 

9.675 

9.680 

9.685 

9.690 

4. 

9.696 

9.701 

9.706 

9.711 

9.716 

9.721 

9.726 

9.731 

9.737 

9.742 

95 . 

9.747 

9.752 

9.757 

9.762 

9.767 

9.772 

9.778 

9.783 

9.788 

9.793 

6. 

9.798 

9.803 

9.808 

9.813 

9.818 

9.823 

9.829 

9.834 

9.839 

9.844 

7. 

9.849 

9.854 

9.859 

9.864 

9.869 

9.874 

9.879 

9.884 

9.889 

9.894 

8. 1 

9.899 

9.905 

9.910 

9.915 

9.920 

9.925 

9.930 

9.935 

9.940 

9.945 

9. 

9.950 

9.955 

9.960 

9.965 

9.970 

9.975 

9.980 

9.985 

9.990 

9.995 


1.77245+ 1/VF == 0-56419 V^/2 = 1.25331 Vc = 1.64872 


Note. This table was taken, by permission, from Marks* Mechanical Engineeia’ Handbook, published 
by McGraw-Hill Book Co. Tliis arrangement was reproduced directly from Pierce’s A Short Table oj 
InteffralSf publ^ed by Ginn & Co., with permission. 
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APPENDIX 2 


TABLE XIII 
Teigonometeic Functions 


Radians 

Degrees 

Sines 

Cosines 

Tangents 

Cotangents 



.0000 

0 

.0000 

1.0000 

.0000 

00 

90 

1.6708 

.0175 

1 

.0175 

.9998 

.0175 

i 57.29 

89 

1.5533 

.0349 

2 

.0349 

.9994 

.0349 

28.64 

88 

1.5359 

,0524 

3 

.0523 1 

.9986 

.0524 

19.08 

. 87 

1.5184 

.0698 

4 

.0698 

.9976 

.0699 

14.30 

86 

1.5010 

.0873 

5 

.0872 

.9962 

.0875 

11.430 

85 

1.4835' 

.1047 

6 

.1045 

.9945 

.1051 

9.514 

84 

1.4661 

.1222 

7 

.1219 

.9925 

.1228 

8.144 

83 

1.4486 

.1396 

8 

.1392 

.9903 

.1405 

7.115 

82 

1.4312 

.1571 

9 

.1564 i 

.9877 

.1584 

6.314 

81 

1.4137 

.1745 

10 

.1736 

.9848 

.1763 

5.671 

80 

1.3963 

.1920 

11 

.1908 

.9816 

.1944 

5.145 

79 

1.3788 

-.2094 : 

12 

.2079 

.9781 

.2126 

4.705 

78 

1.3614 

.2269 

13 

.2250 

.9744 

.2309 

4.332 

77 

1.3439 

.2443 

14 

.2419 

.9703 

.2493 

4.011 

1 76 

1.3265 

.2618 

15 

.2588 

.9659 

.2679 

3.732 

i 75 

1.3090 

.2793 i 

16 

.2756 

.9613 

.2867 

3.487 

1 74 

1.2915 

.2967 

17 

.2924 

.9563 

.3057 

3.271 

1 73 

1.2741 

.3142 

18 

.3090 

.9511 

.3249 

3.078 

1 72 

1.2566 

.3316 

19 

.3256 

.9455 

.3443 

2.904 

71 

1.2392 

.3491 

20 

.3420 

.9397 

.3640 

' 2.748 

70 

1.2217 

.3665 

21 

.3584 

.9336 

.3839 

2.605 

69 

1.2043 

.3840 

22 

.3746 i 

.9272 

.4040 

2.475 

68 j 

1.1868 

.4014 

23 

.3907 

.9205 

.4245 

2.356 

67 ^ 

1.1694 

.4189 

24 

.4067 

.9135 

.4452 

2.246 

66 

1.1519 

.4363 

25 

.4226 

.9063 

.4663 

2.144 

65 

1.1345 

.4538 

26 

.4384 

.8988 

.4877 

2.050 

64 

1.1170 

.4712 

27 

,4540 

.8910 

.5095 

1.963 

63 

1.0996 

.4887 : 

28 

.4695 

.8829 

.5317 

1.881 

62 

1.0821 

,5061 

29 

.4848 

.8746 

.5543 

1.804 i 

61 

1.0647 

.5236 

30 

,5000 

.8660 

.5774 

1.732 

60 i 

1.0472 

.5411 

31 

.5150 

.8572 

.6009 

1.664 

59 

1.0297 

.5585 

32 

.5299 

.8480 1 

.6249 

1.600 

58 

1.0123 

.5760 

33 

.6446 

.8387 ! 

.6494 

1.540 

57 

0.9948 

.5934 

34 

.5592 

.8290 

.6745 

1.483 

56 

0.9774 

.6109 

35 

.5736 

.8192 

.7002 

1.428 

55 

0.9599 

.6283 

36 

.5878 

.8090 

.7265 

1.376 

54 

0.9425 

.6468 

37 

.6018 

.7986 

.7536 

1.327 

53 

0.9250 

.6632 

38 

.6157 

.7880 

.7813 

1.280 

52 

0.9076 

.6807 

39 

.6293 

.7771 

.8098 

1.235 

51 

0.8901 

.6981 

40 ! 

.6428 

.7660 

.8391 

1.192 

1 

50 

0.8727 

.7156 

41 

.6561 

.7547 

.8693 

1.150 

49 

0.8552 

.7330 

42 

.6691 

.7431 

.9004 

l.lll 

48 

0.8378 

.7505 

43 

.6820 

.7314 

.9325 

1.072 

47 

0.8203 

.7679 

44 

.6947 

.7193 

:9657 i 

1.036 

46 

0.8029 

.7854 

45 

.7071 

.7071 

1.0000 

1 

1.000 

45 

0.7854 



Cosines 

Sines 

Cotangents 

Tangents 

Degrees 

Radians 
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ANSWERS TO PROBLEMS 


6. 0.43, 0.69. 


Cliapter I, p. 26 
6. 0.460, 0.348. 7. 0.147. 


Chapter IH, p. 83 

X.y = 1.0003e-«-“^®‘ 0.1815 day-\ 3.82 day*. 

3. p/po = (r/ro)i-“». 


Chapter IV, p. 106 


2. 12.3, 9.9, 8.5. 


Chapter V, p. 146 

4 45r 

n? 


1 . « = - — 5 cos - Y' — sin mB. 


2. 2 / = ^ + Y'. - \ —, + ^ cos (jn^ + tan ^ mx). 

3 ^ m \m^ 

JS 2E 1 . 2ir j j 1 

3. y = — I / — smm — i; m, odd only. 

2 T ^ m T 

ZE/ . 2t 
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‘•'■T+2.V 


1 . 4x 1 . 8 t , 1 . lOx^ , 
lsm-t+-smyt+-smyt +-sm~f + 


y/ZE 

2t 


2x 1 4 t 1 8t 1 lO’T 
cos - 1 - - cos — t + - eos — t - - cos ~ t + 


4 /sin 0 sin 3^ , sin 5^ \ 


. 2 1 , 


2 2 2 1 

.-,joo.2«-p-oo.3« 


2 1 22 ' 2 1 
-s- cosSfl— 7;-cos6^--j-cos7fi■ 
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^ 1 „ . ’Wr . „ , mr \ 1 

7 . « = — 7 :^ > — ; 2 sm — smTOfl +1 2 cos— 1 J costnff | ; 

VSx ^ rtf 4 4 / J 


9. 6.37^(59 - 145.9°). 


Chapter VI, p. 165 

6. 43 X 10“®, 7.1 X 10“®. 7. 0.162, 0.0325. 

& 9 X 10-®i, 7.8 X 10®1“S 89.0%. 

343 


...) 


Mj odd only. 
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ANSWERS TO PROBLEMS 


Chapter Vn, p. 187 

1. O.OOOSg', O.OOIO 4 ', O.OOlSi', O.OOI 85 '. 2 . 0.098 sec, 0.116 sec, 0.144 see, 

0.204 sec. 6. 52.49 °P, 0.9 1.4 F% 1.9 F°, 5.5%, 51.58° F <T < 53.40° F. 

7. 30% to 40%, depending on details of procedure. 

Chapter Vm, p. 203 

1. 9.98 ± 0.03 gm. 3. and a^) 273.150 ± 0.005° K, M 273.154 =b 0.008° K, 
(ap) 273.143 d= 0.004° K. 

Chapter IX, p. 214 

1. 0.06 mm. 3. 0,4%, 3.0%, 1.0%, 2.5%. 6. 0.5K°, 2.2K°, 6.5K°. 

7. 273.45 ± 0.06 mm, 0.05107 ± 0.00007 mm*, 219.1 ± 0.3 mm*, 19.23 dz 0.03 
gm/cm^. 8 . Assume the two 80°45'30" readings to be independent, 1.66693 ± 

0.00005. 9. 0.1946 ± 0.0003, 0.01458 ± 0.00006. 

Chapter X, p. 236 

1. 100.7 ft, 500.3 ft, 151.1 ft, 79.9 ft, 1.4 ft. 2. 60°9.6', 60°0.4', 59°50.0'. 
3. 0.065 mm, 0.216 mm, 0.256 mm. 4. 0.2720 cal/ fern C°), 0.1918 cal/(gm C°), 
1.418. 6 . 8,030 ± 170 cal, 15,300 ± 170 cal. 

Chapter XI, p. 266 

I. 6.47 X 10”*’' erg sec. 2. a,, - 36,606.73 X 10”^ 2^°"^ + 133.72 X lO”’^ 

p/(m-HgK°), 273.174 ± .002° Ki 8. a = 1.00643 cal/ (gm C°), 6 = -495.5 X 10”® 
cal/(gm C°*), c = +8.371 X 10”® cal/(gm 0°^), d = -0.03398 X 10”® cal/(gm 0°^). 

9. log ^ = -6.58 + 374 , AH = -86,100 K° R, 

X.A. I 

II. 78°42', 19°55'. 

Chapter Xn, p, 291 

1. 93%. 2. 97%, less than 1%, 99.5%. 3. 91%. 




